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. . SECTION I . 

INTRODUCTION 

■ Nava managers are increasingly concerned aliout the escalating cost of 
Initiara id follow-on iraining, particularly for sophisticated systems and 
equipment-. In 1976, the Navy successfully employed a relatively new approach 
for the di'velopment and presentation of precommlf siomng (PRECOM) training, 
at an apptrent cost avoidance. That approach involved the substitution of 
Navy deve oped and Implemented training for a siniilar program provided by a 
contracto '. TAEG Technical Memorandum 77-5 (Cordell , Nutter, and Miller, 
1977) documented a study wM'ch examined this approach in terms of its appli- 
cability to other PRECOM training development and implementation programs. 
Because of data limitatlonf, however, the value of such general application 
could not be detennlned. 

The -.tudy reported here was Initially designed to obtain additional data 
by which to validate the fpaslbllity of the Navy developed and implemented 
PRECOM training approach. It was also designed to develop specific cost and 
management guidelines that would aid an acquisition manager in selecting the 
most effective means to aciDmplish Initial training. 1 The generation of 
specific fjuidellnes was dependent upon the development of a comprehensive 
ddta base, consisting of N< vy aind contractor initial training cost and manage- 
ment information. This da a was to be acquired through, case studies of 
representative Navy acquis t1on programs. Although substantial effort was 
made to identify relevant . nd complete case histories (refer to appendix B 
for list <)f commands and at t1vi ties contacted) ,Vrequ1red data were either not 
available or were Incompleie. Major factors contributing to the unavailability 
of approp -late data included: 

• the dispersion oi responsibility and accountability across/ 
within organizat ons 

• a lacl< of clarit^ in and agreement on roles and responsibilities of 
initial training organizations ^ 

• the lack of a certral point for storage of historical cost and 
management data 

' m the lack of a standard format for presentation of detailed cost data 

m the existence of axceptions to^ established policy in the sequence/ 
timing of managerTent milestones. " ^ 

^ Initial training 1s defired as that training provided to the operating - 
cr-w& of a selected humbrr of initially acquired units, t^t and^evaluation 
cr'ws. and prospective Irstructors for follow-on training. PRECOM training 
is^a typo of Initial training. For this report, the term "inpial tja;"^"9 
]l used because it is mme Inclusive. A complete Usting of definitions 
ani acronyms used in this report is contained in appendix A. 
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The lack of data caused the present study to be redirected to the develop- 
ment of a cost management control procedure for contractor developed and 
implemehted Initial training programs; i.e., the centralizing, for management 
purposes, of the records of cost expenditures for each acquisition program. 
Despite the volume of commercially prepared initial training pockages, no 
standard procedures for cost comparison among contractor submissions exists. 
The proposed cost management control procedure has the added capability of 
being used in conjunction with the cost estimation technique reconmended for 
Navy developed courses (see appendix C) to permit quantitative cost comparisons 
between the two approaches. 

During the conduct of this study, the investigation was expanded from 
consideration of only PRECOM training to include examination of case studies 
representing other kinds of 1n1t;al training. The use of this more Inclusive 
term reflects Naval managers* concerns with costs of all such programs rather 
than only those associated with precommissioning details. 

PURPOSE OF THE STUDY . ^ 

The purpose of this study was to develop a cost management control 
procedure to assist Navy managers in making decisions about initial training 
development and implementation in surfacelshlp acquisition programs. Three 
specific objectives were established to satisfy this purpose: 

1. Develop and illustrate a cost management control procedure for the 
centralized collection, storage, and controlof cost data for commercially 
developed initial training programs. Implementation of this procedure would 
aid managers in developing preliminary initial training budget estimates, 
evaluating contractor cost proposals, and comparing contractor developed 
initial training costs with Navy developed initial training costs for certain 
similar courses. 

2. Develop an instrument for the collection of cost data which is 
compatible with existing training requirements directives and the proposed 
cost management control procedures, 

3. Identify and^ undertake a prel imi nary examination of major noncost 
management considerations that would affect the use of the proposed cost 
management control procedures in making specific selections among initial 
training al ternaj^ives. ' 

STUDY APPROACH - ^ 

A subjective rational approach centered about analyses of case histories 
(refer to appendix D for summary of cases studied) was used to meet study 
objectives. Two types of historical da tp were required: 

• Cost data describing all contractual costs and labor effort {man- 
hours) required in contractor developed initial training programs 

. • Noncost management data describing the major program events and 
managaiient actions of representative initial training ^programs from the time 
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of the Operational Requiriment (OR) to CNET acceptance of follow-on' training 
responsibility. 

A slnqle data base that included both cost and nohcost managiment data 
of acceptable qual ity was not available^ consequently, two independent data 
bases were established for the investigation. The cost data were derived 
from training device acquisition programs and the noncost management data 
were derived from major system/equipment acquisition programs. 

COST DATA The cost data base derived from training device acquisition ■ 
pjojramlwas not adequate for the extraction of cost estimation standards for 
operational hardware/ system acquisition programs However t^ese data did . 
suffice to establish and demonstrate the feasibility of the f°P°sed procedure. 
The procedure will require validation using a comprehensive data base drawn 
from operational hardware/system acquisitions prior to future use. 

The cost data Were obtained from Naval Training Equipment Center 
(NAVTRAEQUIPCEN) documentation. Thirty training device course cost proposals 
were examined and nine selected for In-depth analysis on the basis of their 
-completeness. The data were used to: 

define requirements for specific cost labor estimation procedures 
establish major contract cost categories 
Identify primary labor c^lassifi cations , I 
design appropriate cost data collection instruments 
examine cost data input and output format requirements . 
. illustrate the utility of the cost management control Procedure 
identify procedure applications and areas requiring additional 
development, 

NONCOST MANAGEMENT DATA. Since there was.no central -^fPOSitoi^y of documen^^^^ 
noncost management data, the majority, of useful case study informat on was 
acQuired through discussions with knowledgeable personnel r examination of 
I5a1 Hie fSrtted records supplemented these discussions Fourteen programs 
were Identlfild as candidates for in=depth case study, only five of these 
fourteen programs contained sufficient data to warrant serious review. Even 
though the data were not complete for even these five cases, they were suffi- 
cient to allow prel iminary identification and description of noncost considera- 
tions affecting the cost management control procedure. 

In some instances, sufficient data existed to permit the development of 
milestone charts which indicated the relationship between '"W^'.f ^"^1;^^^ 
training* decision points and required acquisition decision points. These 
milestone charts (see appendix D) were used -to examine the question of standardi 
zation of proceduris among acquisition programs and to identify areas requiring 
development of sound management decision guidelines for initial training 
' development and implementation. 
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STUDY L IMITATIONS AND CONSTRAINTS 

The fundamental limitation of this study is the data base from which 
concepts .ind conclusions are derived. Whereas the data base Is adequate 
for the dovelopment of an Initial cost management control procedure^ 1t is_ _ 
not of sufficient size or validity to derive reliable cost estimation statistics. 
The cost f i gures and related calculations presented^in subsequent sectio ns of this 
report are for fllustratlve purposes only and should not be used as^he 
statistic al basis for budget estimation, contractor proposal evaluation, or 
initial t raining a,lternative comparison . Substantial quantities of additional 
cbmprehensi ve cost and management data are required to completely develop the 
procedure examined In this Investigation. Acquisition of such data will 
require the comprehensive study of the complete history of numerous acquisition 
programs. 

In addition' to the limitation just identified, the following constraints 
affected the conduct of the study: 

• Only all-contractor or all-Navy developed/implemented initial 
training programs were examined. No appropriate case history reflect- 
ing a combined effort by Navy and contractor personnel to develop 

and implement an initial training course was Identified. 

• . Data for this study was acquired only from surface ship acquisition 

programs. Thus, preliminary findings should be restricted In their 
appltcatlon to similar programs. 

ORGANIZATION OF THE REPORT 

In addition to this introduction, three major sections and eleven appendices 
are provided. Section II describes the development of a procedure for cost 
management control of contractor developed Initial training programs. Illus- 
trates concept utility and application, and identifies future required develop- 
ment/validation requirements. Section III Identifies and describes major 
noncost considerations that affect the use of the procedure In mlMng initial 
training selection decisions. Section IV contains study conclusions and 
recommendations, \ 
. ■■ ■ , ' " \ 

Appendices A through C provide, successively, a compendium of useful 
definitions and acronyms, a list of commands and activities contacted, and 
an Illustration of . a cost estimation procedure for Navy developed Initial 
training. Appendix D contains a suninary of each of the cases studied. 
Appendix E Is a copy of the data collection Inttpument for contractor developed 
initial training courses and appendix F provides a computer printout of the 
data used In developing the cost management control procedures. Appendices G 
through K present cost data for various Initial training courses. Using the 
format described in the report. 
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SECTION 11 



A COST MANAGEMENT CONTROL PROCEDURE FOR COMMERCIAI.LY 
DEVELOPED INITIAL JRAINING PROGRAMS 

/this secitlon of the report presents a discussion of the steps underttken 
in the develofnient of a cost management control procedure^for^ budget estrmati on 
cos't estimation, and program evaluation for commercTaTly developtd Initial 
tPainlrig programs! provides iMlgHt to the application and utility of the 
pr-oc^u^e throMgh lllustratloni and Identifies areas requiring future eff^t. 
DeveTopment of the procedure included^ ' . 

Identification and development of an acceptable data base 

orgahization of data by. major contractual cost categories 

analysis of Tabor'- category elements 

design of cost data conectlon instrwnent^for cpritractor developed 
Initial training programs , ^ 



i 



examination of procedure utility and data presentation/ formats 

niustration of procedures for comparative analysls'^of Initial 
training cost| ■ - r , \^ 

appltcation of the cost management control procedures to major 
acquisition programs 

identification of required future development effort. 



DISCUSSION 



Initial efforts to identify and acquire necessary cost data revealed a 
requirement for an initial • training cost management control procedure to 
include an unsophisticated, user oriented, standardized technique for devel- 
oping preliminary budgetary estimates and a standard method of evaluating 
contractor proposed Initial training tqsts. Further examination of this ^ 
requlr^ejlent resulted in the definition of specific design considerations .or 
the prMedure. These considerations irfcTudf the following: 

• central storage of initial training cost data 

• ready accessibility; 

• minimum. data input requirements 

• cost efficiency ' 

« data update capability / . .. /V r-*--"""" 

• . representative of all types of contractor conducted initial training 

• user oriented. 
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Num<>rous concepts have been proposed as tools to Improve the management 
processes and overall efficfency of -Government-sponsored programs. Based on 
these concepts, models have been proposed that are theoreticany and mathemat- 
ically correct'^ pften, however, these models are not implemented or used 
because of (I)' the lack of a valid requirement, (2) a lack of interest, (.3} 
technical complexities, (4) difficulty^in accessing, and/or (5) excessive 
implenientatlon costs. Basic considerations , tn the development of any model 
should include the user's background, the user't specific requirements, and 
ease of utilization. These considerations were paramount in developing the 
cost management control prpcedure that follows. 



DATA BASE / 



h% was previously ;4tated, major operational pystem/equipment cost data 
were ina^equatei Therefore, It was necessary to use cost data contained m 
contractor training device cost proposals submitted in response to various 
types of training device solicitations. Of particular relevance to this 
study were those portions of the costs for development and implementation of 
training device maintenance and operator training courses. The types and 
categories of development effort and attendant costs required for the devel- 
opment of training device courses closely parallel the effort and costs 
required for the development of initial training programs; for operational _ 
systems/equipment. However, it 'should be noted- that the amounts of effort 
and cost will vary betwefen operationaT system/equipment initial training, 
courses and those for training devices. Mbreover, costs used for training 
devices represent proposed contractor costs, and these may ^lot reflect fina-l 
negotiated costs. For purposes of developing the procedure, neither, of these 
two factors is considered serious. .However, it is important to reiterate 
that dollar and hourly figures derived. from the nine cases examined .are 
computed for illustrative purposes only. They should not be used in esti- 
mating future course requirements costs, even though data describing major 
cost categories, labor classifications, and development effort appear reasonabl 
and may generalize to hardware acquisition programs. However, before general- 
izing training device initial training data to operational systems, more data 
must be iexamtned. ■ 

DATA "organization 

To organize the data, major contractual ciist categories were first 
identified. The perfcent of each category relative to the total contract cost 
was then-'ComputetfT^ The six categories Identified were- 

•, labor 
•. >0verhea_.d 

' general and administrative (G&A) 

• ' profit . 

• material ' • 

• travel . ■ . '• ' ' ' . 
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these categories are shown 1n figure Tas mean percentages of the total mean . 
course costs of the nine cases. Mean percentages were calculated by deternnn- 
ing the average cost per category per instruction hour for each cost proposal 
and dividing by the average total contract cost per instruction hour. The 
percentage cost per category, was established by dividing the average category 
cost- per instruction hour by the average contract cost per instruction hour. 
The classification of funding' categories appears rpasonably accurate in terms 
of expected percent distribution of funds. 

A seventh classification was originally considered for inclusion as a 
separate funding category. This classification would have reflected miscel- 
laneous type costs that did not conveniently fall within the six, funding 
categories identified. • Available data indicated the occurrence of this 
"Other" category funding to be infrequent and, when present in cost proposals, 
to be less than two percent of total training contract cost. For this reason, 
that category has not been Included here. " 

ANALYSIS ' " . , 

The analysis which follows is based on the costs per instruction hour 
and percentages of total costs shown in figure 1. • 

Labor and Overhead categories comprise over 70 percent of the total 
contract cost. Overhead is normally established as a function of labor cost; 
the percentage varies wfth the contractor. Thus, of the six funding categories 
labor, with its. Influence on overhead, has the single greatest influence on . 
the total cost of. developing and implementing a, training course. Each of the 
remaining four categories represent small percentages of the total contract 
cost. Moreover, they are reasonably predictable and measurable. It is the 
labor category where the least exact training course cost estimation and cost 
evaluation- procedures exist. For these reasons, emphasis has been placed on 
examination of the labor funding category and Its component elements. 

The cost of labor Is determined by four basic elements: (1) labor 
hourly rates, (2) labor classification, (3) labor effort, and (4) labor 
distribution. 1 Labor hourly rates by labor classification are variable, yet 
predictable, and require no explanation. An 'Identification and standardized 
■listing of labor classifications is found in table 1. The 10 classifications 
were derived from a review of contractor cost, proposal data and are typical 
of what is required for training course development and implementation. This 
listing may'require revision when a larger sample of initial training contract 
data is submitted to analysis. , 



TABLE 1. STANDARD LABOR CLASSIFICATIONS FOR INITIAL 
TRAINING COURSE DEVELOPMENT 



Labor 


Classification V 


. Manager/Supervisor 
; Training Specialist 
Engineer 
Senior Engineer 
' Typist/Clerical 


Senior Instructor^ 
Technical Writer 
Instructor 

Illustrator/Draftsman . ' 
Technician 
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The elements of labor effort and labor distribution are derived from^ 
data collected from course review. They could not be quantitatively examined 
in this study until an appropriate format had been developed for thelrorganiza- 
tion and summary. To provide for this requirement, a data collactlon instru- 
ment was designed and a trial computer program developed for Investigative 
purposes. , ^ 

DATA COLLECTipN INSTRUMENTT Identification and organization of' the cost data 
requirements to be included in the data collection instrument guided its 
The following criteria had to be met: 

compatibility with standard contractor cost accounting procedures 
readily transferrable to computer data bank 

reflects the true labor effort neces5,ary to meet Initial training 
development standards 

capability for the accommodation of future requirements. 

The data collection instrument developed is presented in appendix E, It was 
.modeled after a NAVTRAEQUIPCEN form used in contract negotiations for training 
device training courses. The format 1s based on the assumption that MIL- 
STD-1379 (A) will be. used. as the basic standard from which the Data Item 
Descriptions (OID's) are selected for all Initial training course contracts. 
Parts I and II of the instrument address development effort and costs; Parts 
III and I.V address the Implementation effort and costs; Part V presents the 
G&A. Overhead, and Profit costs typical in all contractual efforts; and Part 
VI is a surmation of the previous five parts and presents the total manpower 
effort and costs for the total Initial training program. 

PROCEDURE UTILITY. The information obtained using the data collection Instru- 
rrtent will enable the development of a statistical baseline. This should 
prove a valuable tool for decision makers concerned with initial training 
cost efficiencies in the following ways: 

• develop budgetary cost estimates , 
m-i evaluate contractor, cost estimates 

• compare contractor training development costs with Navy, training 
development costs (see appendix C for Navy Cost Estimation Procedures) 

^ The most efficient means of establishing this co^t baseline is through 
the use of eomputers as storage and computational mediums. To Illustrate 
this point, and to verify the utility of , the proposed cost data collection 
instrument, a trial computer program was developed to .provide information on 
labor effort and Tabor distribution, Although the sample of nine training 
device coyrses was not large, it does permit the demonstration of alternative 
ways that data can be manipulated and presented to rrteet the needs of the 
initial training manager. Modifications to both the Instrument and the 
computer program can be made as experience is gained In, th#1r use. The 
computer program for the cost management pontrol procedure was developed 
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using a WANG programmable calculator. The program itself is not included in 
this report; however; a sample copy of cost data output is provided. in appen- . 

dix F. ^ . :^ = ' 

Cost data outputj as presented in appendix F, can be put to several uses - 
bearing in mind the following three constraints: 

m Mean statistics (e.g. s mean cost, mean hours * etc, ) are most meaning 
ful when expressed 1n terms of mean cost per instruction hour 
and/or mean labor hours per Instruction hour. This fact was not 
discovered until late in the program. Thereforet sumnary figures 
in appendix F are expressed in terms of (unit) per instruction 
hour; the ri^mainlng figures are not. Since the data /presented 
in appendix F are for 11 lusjtration only, the remaining figures were 
not i^onverted to (units) per instruction hour. 

• All means were computed using an N of 9* This is satisfactory for- 
each o1^.the six contractual cost categorieSt except travel . That 
category appeared in only six of the sample cases. Although this / , 

. difference in sample size causes s slight error in^the resultant 
ratios and percentages * 1t dpes not detract from the basic procedure 

• For purposes of this investigations appendix F data Is presented i^n 
several different formats. Appendix F 1s not intended to represllnt 
a final data presentation fprmat for the cost management control; 
procedure, but rather to illustrate several methods for displaying 
the data* Furthert not all data (e.g. ^ researchs liaison) required, 
by the data collection instrumant were separately Identified, 
However; the total effort and cost of these omitted components/ Is 
included in one of the. other six categories. Wore detailed Investi-- 
gation may warrant the inclusion bf . such data at some future date. 

Figur^ 1 provides one method-of summarizing data found in appendix F." 
Based oh figure U the mean cost of $324,86 per instruction hour could be 
used in preparing budgetary cost estijuates for prospective training courses. 
Only the course length* in hoursV Is needed to complete such an estimate. In 
all likelihood, course length would be an estimate based on experience /at 
this early phase of the acquisition cycle. Later, the data in figure' t^could 
be used during contractor cost p^roposal evaluations to determine whether the 
proposed costs are reasonably cl,ose to , the mean cost and the cost distribu- 
tions* proposed costs and cost distributions not falling within acceptable 
limits for a specific cost category could be identified for more detailed 
analysis. In addictions this procedure could be refined to Include additional 
factors such as the type of equipment for Which the course is being developed, 
the technical complexity of that equipment, research effort required, method 
of instruction proposed (CAI, lectures laboratorys etc*) and/or the type of 
abquisition (new equipment, modified equipments etc.). 
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As previously stated, the ilabor cost category has the greatest Impact on^ 
the total cost of the contract.' Figure ZA is a breakdown of the total labor . 
cost category depicted in figure 1 . It depicts all labor: classifications 
included in the Tabor cost\category by mean time and percentage of the total 
time using the data from appendix F. The Information displayed in figure ZA 
could be used for two purpoles" , • 

• to prepare budgetaiy estimates during the early planning phase of 

the acquisition cyale . 

« to compare, upon receipt of contractorCs) proposals, the proposed 
labor costs and labor, distribution to Identify areas outside of , 
established tolerances. ? v 

Figures 28 and 2C depict labor distribution statistics for the development \ 
and implementation effort, the sum of which equals the total effort (figure \ 
'2A). Only seven labor classifications are shown in figures 2A, 2B,_and 2C \ 
instead of the 10 developed for the data collection instrument. This is ^ 
because the sample -cost proposals selected did not Include the three missing 
labor classifications-, ">iowever, it is anticipated that these classifications 
would appear in a larger sample. . » 

The important point regaling the statistics presented in figure' 2 is 
that they are based on an 'N of 9 from a very, restrictive type of procurement. 
If fevery labor classification appeared in every case, the statistic^ would ■ 
give a more meaningful repre^sentation of labor distribution. Gross statistics; 
i.e., 13.3 labor hours per instruction hour for total labor effort, 1.7 labor 
hours per instruction hour, /for Imolem^ntation effort, and 11.6 labor hours 
per instruction hour for development effort, are valid and usable in the 
evaluation of overall contract costs., The breakdown of these gross statistics 
by labor classification is not meaningful until verifiad. ■ 

Figure 3A depicts statistics based on the mean cost per instruction hour . 
for each labor classification, again based on an N of 9 courses. The identical 
rationale relevant to the statistics of labor hours per instruction hour, as 
depicted by figure. 2A, is applicable to the computation of the statistics 
presented in figure 3A., The mean cost of $133.43 pfer instruction hour for 
the totaleffort, $17.81 per instruction hour for the implementation effort, 
and $n5.'62 per instruction hour for the developmenli effort pre probably 
valid; the breakdown of these statistics by labor ^cT^sification Is not 
representative until verified by additional data. ^ i 

Table 2 presents mean cost estimates by labor classification. These 
statistics were developed by taking the number of cases in which each labor 
classification appears and calculating the average hours per instruction hour, 
and the cost per instruction ho.ur. The difference between f1|ures 2 and 3 and 
table 2 is that in thfj figures all^nlne cases were used in de\^tlop1ng the 
mean; in table 2 only those cases wherein a specific classiflcatTon appeared 
were considered Because table 2 is based on actual case labor classifications, 
1t isa for Illustrative purposes, considered the standard for comparative - 
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Figure 2. Summary of Initial Training Mean Labor Effort 
by Ubor CUsslflcation \ 
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lirtlof InstFUctor " 
i. 47. S% 
b/ $63,14 



Technicil Hrltir 
i, 10. 4^" 
I1J.S3 ' 



Engintif 

a. 8,11 
bp $10.98 



niustritor 

a. J. 51 

b. $3.11 
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IriitfyctOr 

a, 23,11 

b, $31,37 



Typist 

a. i.Sf 
^b. $7,3S 
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Senior Jnitructor 
.a. 48! 81 
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n lustrator 

a. I, SI 

b. $3.29 
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Figure 3. Summary of Initial Training Mean Labor Cost by 
Labor Classification ' - . 
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analysis. For exampli, the managerlaT function classification appeared 1n 
five of the ninet cases considered,. In figure 2s the hours per instruction 
hour were determined by surmlng the five cases (1*88 hours of total mana- 
gerial hours per instruction hour) and dividing by nine. In table 2* the same ^ 
sum was used p but the divisor was flvsj the number of cases In which mana- 
^er^jl labor was Identified, 



TABLE 2, MEAN 


COST ESTIMATES BY LABOR 


CLASSIFICATION 


Labor Classification 


Labor Hours Per 
I/)struct1on Hour 


Cost Per Instruc- 
tion Hour 


1, Manager 


.4 


$ 4.80 


2. Engineer 


3.6 


32.91 


3, Typist 


2.1 


^ 9.45. 


4. Instructor 


5.4 


47.06 


5, Senior. Instructor 


8.5 


. 115.09 


6. Technical Writer 


3.6 


31.12 


7, Illustrator 

i — , ^ — - ^ — 


.7 ' • 


5.91 ' . . 



PROCEDURE ILLUSTRATION. To niustrate the use of the procedure, a specific 
training course (Course '^L" in appendix F) will be subjected to a comparatllve 
analysis. As a first. step, the manager would develop a simple table depicting 
overall costs per instruction hour by contract cost categories and compare 
these to established mean costs (the co|ts identified In figure 1). ^ This pro- 
cedure ismustrated in table 3, Since no traveT appaared in the contractor's 
cost proposal , the al locattpn for travel is not included 1n computing the mean 
total costs (line i) or the' percentage of mean costs devoted to each categ[ory ! 
(Vine Z), Table 3 reveals three categories where proposed course L costs / 
exceed the. anticipated (mean) costs by a significant. percentage: labor, over-/ 
head, and profit. In additidns the material category Is significantly less / 
than expected. The labor category is the most costly and has the greatest / 
Effect on total contact cost. Moreover, since overhead, G&A, and profit cate- 
gories are based on' a percentage of the sum of the other three categories, 
any reduction in the labor category would reduce those costs proportionately. 
Reduction in labor^costs would, also raise the percentage of material costs' 
relative to the^ total contract cost. Thus, further examination of the pro- 
posed labor costs should be undertaken. 
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TABLE 3. .:tOHPARISON OF COURSE L CONTRACT TRAINING COSTS TO MEAN CONTRACT 
' TRAINIl COST BY CONTRACT m; CATEGORY ' • = 

' ■ ' CONTRACT COST CATEOORY ($/In. Hoyrj 
STATISTIC LABOR MATERIAL TRAVEL "^OVERHEAD m PRO FIT TOTAL ■ 



1, Mean (Figure 1) 


133.43 


14.49 ^ 


NA 


98,04 : 33.48 34, 


62 314.06 


I 1 of Total (Figure 1) 


11,491 


4.611 


NA 


, 31.221 , 10.661 11. 


021 ' ' ^ 


3. Course' L ^, 


195.79 


4.70 


0 


129.61 37,63 65. 


16 ' 422.91 


4.1 of Total (Coursi L), 


46.301 


1.111 


0 


30.651 '8.901 .13. 


041 


5.- Differince (3^1) 


.'+62,26 


-9.79 


NA 


+31.57 +4.15 +20. 


54' +108.8| 


i 1 Difference (en) 

1 ; " • ■ 


+46,701 


-6?,56r 


NA 


+32,201 +12.401 +19, 


331 +34.66^ 
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One means of examining labor costs more closely consists of construating ^ 
a pie chart of the contractor's proposed labor distribution using hours of 
labor per Instruction hour and a second pie chart based on the contractor's 
proposed cost per Instruction hour by labor classification. The two charts 
developed are shown 1n figures 4A and 4B. Figure 4A Indicates the total 
hours pev- instruction hour required to develop and present course L were 
13.76, a difference of only 3,45 percent from the mean shown in figure 2A, an 
apparently acceptable difference, > However, figure 4B shows thac labor costs 
average $195.79 per Instruction hour, a difference of 46,7 percent from the 
expected mean labor cost indicated In figure 3A, This difference is considered 
significant. From these facts, a manager might determine that either excess- 
ively priced labor classifications are proposed or that the cost of the labor 
classifications is significantly higher than anticipated. In the Course L 
illustration., a combination of both, occur. The contractor proposed to use 
only senior Instructors, no technical writers, engineers, or Instructors* 
The contractor's senior Instructor's cost of $174.94 per instruction hour is 
52 percent over the mean cost for this labor classification (see table 2). 
If the manager procuring Course L had had this model available, he would have 
recognized the are^ which required additional negotiation. 

PROCEDURE APPLICATION TO SYSTEM/EQUIPMENT ACQUISITION PROGRAMS,^ Some unsub- 
stantiated cost data for major hardwarp system/equipment acquisition program 
initial training courses were obtained during this study. Major programs 
^eppesented included the CGN-28. Combat System Maintenance Management Training 
(CSMMT) .course, three proposed 1200 PSI training device courses, and the FFG-7 
Cehtral Control System Maintenance course. These data were converted to the 
proposed data collfection Instrument format, and p1e charts were developed J n ^ 
accordance with the cost mMiageme/it concept for each course, < The resultant 
statistics are presented In appendices G through K for information purposes^. 

FUTURE DEVELOPMENT EFFORTS 

This s^ectlon of the study has developed a cost management control pro- 
cedure and demonstrated Its appTicatlpn. More exact techniques for the 
estimation and evaluation of initial training costs are needed. Numerous 
areas exist which require additional investigation and analysis to complete 
the development and vaTidatlon effort.' Suggested areas for future investiga- 
tion and/or development are presented 1n the following paragraphs. 

1. , Data Ba^e . A primary, and obvjously crucial, requirement is the 
dewTppmeht;^ substMtiW d^a^^^ on valid contractor' 
initial training cost data. All. data fiements comprising this base should-be 
collected In the standard format presented in appendix E, 

2. Verificati^on of Cost Categories and Category Classification . Cost 
categories identified 1n this repp^t and the classification schema for the 
Labor Cost Category require verif ttatlon. The possible need for additional 
cost categories has been indicated; because of its importance, the various 
types of labor classifications also need validation* In addition, considera- 
tion might also be gfven to separating types of travel costs (development and 
implementation) or developing other classifications for the various cost 
categories, As additional data becomes available, revisions/modifications 
should. M) ll#rted • ; / I ^ ■ ^ r . - 
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Figure 40> Total Labor Cost Pir Instruction Hour 



Figure 4. Course L Proposed Labor Effort and Labor Cost by Labor Classification 
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3. Course. Location . The location of training courses (e^g,^ factory 
or onslte) may affect cost category statistics. Such impact, if any, shQuld 
be determined. Category costs may also vary dependent on the amount of 
travel required. 

4. Training Course Classification . Technological advances may cause 
technical complexities in course development efforts ^ special user requirements, 
etc. These and similar variables may affect costs of developing and implementing 
Initial training. In th^jse cases there may be required the determination of 
trainiD£^ourse classifications by technical complexity; however^ the number 
should be^eld_to a minimum, 

5. Instruction Techniques . The influence of types of instruction 
(e.g., classroom, laboratory, class/laboratory mix, CAI, etc.) on cost per 
instruction hour should be examined. 

Statistics. . The basic statistic used in' the appendix F data was 
the mean. Consideration should bfe given to the use of other statistics, such 
as the median, to form the baseline for cost estimations and evaluations, A 
procedure for establishing cortfidence Intervals for cost statistics should be 
developed, , . 

7, Course Length . Course length is a variable that influences the 
statistics for cost per instruction hour and labor effort per instruction 
hour. Groupings by course length may demonstrate a need for statistical 
baselines, for each interval. As an example. Intervals of 0-160 hours, 160- 
320 hours, and*320-480 hours were arbitrarily establ ished from available data, , 
and averages of cost per, instruction hour and development hoUrs per instruc- 
tion hour data were derived and plotted against course length (at the midpoint). 
The resulting plots, shown In . figure 5, suggest that both. cost per instruction 
hour and development labor effort per instruction hour decrease as course 
length increases. Considering the quality and quantity of the data from # 
which the plots were derived, this study In nd way implies that the negative 
slopes shown in figure 5 are representative of what actually may exist. 
However, future investigations should consider the relationship betwetin 
course length and cost and labor effort, ^ 

. 8^ Data Output Display . Future investigations should address the 
format and Information content of the final data output. The final output 
data should^consist pnly of required information and be readily interpretable 
by the user. • ^ ? 

SUMMARY '•■ , . ■ , 

The cost management cohtrol. procedure presented in this section is / 
intended as a decision aid for the acquisition manager of initial training 
programs. As such, it provides factual information which can assist him in . 
the selectton of the most appropriate and cost effective initial training 
alternative for a given acquisition. Decisions should not be based on assump- 
tions;when factual information 1s available to aid 1n the decision making, ^ 
Cleanly, the use of this procedure is preferable to decisions based on assump- 
tions and/or unsupported Judgment, On the other hand, costs alqne should not 
be the only criterion upon which an initial training decision is based. 
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If devilopint of the proposed fmim \l pyr^ued rlgorfluslj, M 
mm] protot will be a tabylation of relewnt ccit ^tati^tics it can be 
ypdited rf Wly to iccoiodati ctoges in tte data feaie. M ,variaM« 
!ych as coyrse length, location, tpof tralniog, and eoyrse Mpl'ixiti, 
lanasers can locate the appropriate stitlitlc(s), detmine profeabli costs ^ 
for socM coyrsii and e^aiite sybilssions based on dwiations from realistic 
' istiitei of anticipated coyrse costs, Proposed contractor costs and effort_ 
for each of the major cost categories, perhaps broken down into classifications 
within catagories, coyld be verified throygh coiparisoii with lean statistics, 
Thys, the reasonableness of contractor proposed cbsts for particylar coyrses 
ynder consideration can be lstablished, The intint and pyrpose of the cost 
estiitlon/e^ilyation procedyre presentid here is well -syiarized in 
tat 



iy foriliiing the procedyres of analysis and laling eKplicit 
k facet of the analysis, lanagers mil have a powerfyl tool , 
to lid in decision laling, Econoiic analysis was not intended 
to, nor coyld It, * the decision, Ihere simply are too my • 
qyalitatiye factors involved in ist decisions, to enable the 
analysts to select a set of gyantltatlve criteria which caii be . 
ysed alone as the basis for laling totally objective decisions. 
Jydgint and eyalyation have always been regyired in inageient 
and decision making and will contlnye to play a significant jole. 
When the aiynt of jydgient regyired can be redyced by eKpilcit 
econoffllc analysis then decisions shoyld be measyrably improved 
(Swope,ll,p..43), 
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SECTION III ' 

NONCOST FACTORS INFLUENCING, SELECTION .AMONG 
INITIAL TRArNING ALTERNATIVES 

Assuming Its availability and cdmpletaness, an analysis of cost data 1s 
an essential and critical part of any initial training decision procass. 
The preceding section of this report presents a cost management control 
procedure that Is designed to provide such cost data. .Howaver, jt Is Insuffi- 
cient to use/quantltative informatlonp such as cost, by Itself in selecting 
among initifi training alternatives for program develoixnent and ImplOTantatlon, 
This section identifies and descrlbas, in general termSp major noncost 
factors that are relevant to a comprehensive Vavlew of all available data 
affecting the selection process* 

Noncost factors are essentially qualitatlva In nature. As such, thay 
are: ^ 

• not normally described by objective data and, tharefore, are not 
easily assigned values for objective analysis 

m extremely interactive in that thay affects and are affected by, 
each other and quantitative factors such as cost 

• broadly Influential ; a decision based on any single factor may have 
effects that extend beyond the general area where the effect was 
anticipated 

• long term in their effects* 

.Identification of these, factors resulted from case history analysis. 
For purposes of this presentation, they have been separated Into two arbitrary 
groupings: first, factors that specifically relate to the cost management 
control procedure developed in the previous section; and, second, factors ^ 
that require more general considerations This Is considered to be an Initial 
list which is by ^no means comprehensive or exhaustive. Additional factors 
may be identified as experience fs gained. Moreover ,^ because of insufficient 
documentation on which to base specific conclusions, estimates of the relative 
Importance of these factors can not be derived. Although their effects are 
generally understood, significant effort is required to definte both the 
factors 'and= their effects more accurately. 

QUALITATIVE FACTORS RELEVANT TO THE COST MANAGEMENT CONTROL PROCEDURE 

The factors presented in this grouping tend to be specific In terms of 
their influence on the cost management control procedure. They Influence 
cost estimation and evaluation and/or will serve as the basis against which 
specific trade off. decisions can be made. They include, but are not limited 
to, the following: 
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1 Course Type- Guidance on the selection among initial training 

courses both of which require training devices or operational equipment, 
sSSSIII'aTfffrent oriental The difference 1;i cost to develop and 
im??Snt each of"these types of courses will vary and ™y;^f «ntually, be 
identified. A consideration of the orientation of the course will D^^^^ 
necessity as the training manager decides who phould develop the course 



needed, 



? Courst: omDlexity. The type of hardware under development dictates 
courshoJfifVlMaquire ^ ^^^-T^^i^^m^^^^ 
ment and implementation personnel , a special physical P^jnt, °J^f ^^fj ^""^ 
to be considered during the decision making process. For example, n new 
equipment reflecting sk recent technological ^f^'^^^^^^'^^^^i.^ 
into the Navy, It is doubtful that Navy personnel would possess the knowledge 
needed to develop and present Initial training courses for that equipment. 
Under su?h circumstances, contractor development would probably be selected. 

3 Course Length. Course length obviously affects course costs. It 
also aks irrtuifnitlve.way to affect "the initial training altpnative 

4 Taraet Student Population. The characteristics -of the ;student 
population WiiroileWsereFtion decision for Initial training develop- 
St aSd° implementation by Navy or contractor personnel Fo^^^^^ 
trainina courses for officers may be different than similar courses Tor 

enl sted personnel? Within the enlisted ranks, the level of expertise required 
or anJlcipatld w?li be different among courses targeted for schools with 
different technical levels of capabnity. 

5 Process Factors. The differences in process that, exist between the 
Navy and Vontrac tdr develo pment of Initial training programs may influence 
the selecHon decision. Within a normal procurement cycle, contractors are 
subilct to a variety of requirements during Procurement Panning (identification 
of rlSlrynlflfLquest -for Proposal 

rohtract award) and Post Contract Award contract award to delivery or 
CO If pa es that Na" developers may not be required to meet. Therefore 
Navv personnel may be able to complete the process in less time. The effect 
ofyrdifJeren?^^ may be reflected in terms of time to accomplish, 

urgency of requirement, and/or cost. 
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In addition, the award of a contract tQ a vendor rtquires different 
management controls than might be, found if similar work were assigned to a 
Navy organization. The kind of coordination required for a specific course 
may be more effectively accomplished under one set of controls, influencing 
the selection of one developer over another. 

Process factors may eventually be'translated into dollar amounts for 
inclusion in' objective cost analysis using the proposed cost management control 
procedure. However, until more data become available^, the influence of these 
factors will remain essentlany a matter of personal judgment and subject to 
trade-off analysis. 

6. Facility Factors . The availability of facilities in which to 
develop and/or implement Initial training courses may influence the selection 
decision. Space may be available to the Navy on a no-cost basis for Internal 
course development, as was the case when the Navy developed the CSMMT course 
for the CGN-38. .Requirements for Implementation may include the need for 
large amounts of 'space, as Illustrated by the DD-96^ Initial training course 
for engineers. The cost of required space, and Its availability, will bear 
on the decision ol" where to present the course. Other facility factors which 
must be considered during a trade-pff analysis are proximity to the work 
force and, possibly, terrain characteristics. 

7. Security . Certain courses require stringent security measures. 
The abi IJty of a con tractor to insure such measures involves consideration of 
the availability of personnel who can meet clearance requirements In addition 
to physical plant and document security. Under certain conditions, It is 
conceivable that this variable might become a determining factor In a selection 
decision, ■ 

GENERAL qUALITATIVE FACTORS ■ 

The three qualitative factors which follow are generally applicable to 
all aspects of the initial training process. Although they are important 
considerations in the selection of one initial training development/Imple- 
mentation alternative over another, they may also Interact in decisions 
related to funding and/or logistic support, . I . 

■ f. Change . Selection of an .agent for initial training development/ 
implementation should not be made without some consideration of- his ability 
to accommodate change. Consideration of the capability of the contractor or 
the Navy to modify training to acconmodate changes In minimum time at least 
cost must be considered by the acquisition manager in the selection of the 
training agent. . , 

The followlrig are ilTustrative of the types of changes that might occur: 

• Technological Change. Rapid advances in technology may dictate, 
modification requirements' for a system/ equipment under acquisition. 
These changes imply a concurrent change in instructional programs 
being developed to supporf it. In making a selection decision, 
training managers should consider which agent can best accomiTiodatt 
. such change. Included as elements in this consideration are the 
technical 'abilities of personnel, the capability to provide retrain- 
ing, .if required, and instructional flexibility. 
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Funding Change. Three potential types of funding change must be 
considered by the acquisition/training manager. The first of these 
involves cost changes (material, labor, etc.) which are norniany 
considered as a part of an objective cost analysis/esiimatlpn 
procedure. Secondly, acquisition/training n«nagers must be prepared 
to accomnodate changes 1n funding source (e.g., from RDT&E accounts 
to procurement accounts)* with attendant changes in requirements. 
Lastly, changes in the more general levels of defense budgeting 
occur based on Congressional actions. Each of these three types of 
funding change impact acquisition programs. Since training considera- 
tions are generally subservient to hardware considerations, any 
. Initial shifting of funding Is done to Insure the least effect on ' 
the actual hardware, creating a negative influence on training, 
funding. Thus, acquisition managers must consider what kind of 
training developer, contractor or Navy, could best accomnodate such 
actions should they occur. ) 

Changes in Instructional Technology. As in the growth of technology 
for system/ equipments, technical advances in state-of-the-art 
techniques and methods of instruction occur. Such advances may 
affect courses being developed/implemented and have Implications 
for the coordination between Initial training and follow-on training 
activities. Specifically, response to a change In instructional 
technology implies three considerations: cost, time, and capa- r, 
bility to Incorporate the change in the course. Acquisition managers, 
in the selection of a training agent, must jive weight to these 
factors, particlilarly for long-range programs. 

2; AttltudinaT Factors . The attitude; i.e., general atmosphere, which 
surrounds the initial tralnfng process affects the actions and behaviors of 
the working level personnel. The approach decision makers take to solying 
problems is strongly affected by their attitude toward the program. These- 
two attitudes Interact, and decision makers must be concerned with these 
attitudes when making, the initial training development selection. Two probler 
areas are of particular concern In making the initial training selection 
decision: 

The Low Priority of Training. Despite policy provisions to the 
contrary, personnel preparation through training has assumed a role 
- secondary to that of material acquisition. The impact of this 
condition is seen in reduction of training and. training-related 
. funds during times of monetary constraint, failure to make a timely 
assignment of adequate numbers and types of training personnel, and 
scheduling slippages because of inadequate attention being paid to 
training needs. The training agent selection decisiph should _ 
consider the capabilities of the Navy and the contractor to respond 
to these types of problems should they occur. 
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' • • Competition Among Affected Commands. An Increasing tendency to 
become concerned only with those factors that are of Immediate , 
concern to a specific agency has led to a competitive attitude j 
between commands resDonsible for Initial training and those responsi- 
ble for follow-on training. This is further aggravated by resource 
Hmftations. This can result in program disruption. Inadequate 
documentation and/or training support, and insufficient coordination/ 
communication during the developent process. Awareness of theie 
potential problem areas is essential in making training program . 
decisions., ' 

3. Hanagemeht Factors . During the data gathering phase of this study, 
it became apparent that factual information related to resource expenditures 
and equipment history was not readily available. Cost data was scattered 
among various activities and was not maintained In a consistent and usable 
fonn. Historical data was, generally, available only from persons who_had 
been involved with the decision making process. Acquisition managers fre- 
quently relied upon individual notes or maTiory rather than formal documentation, 
and problems were evidently solved more by intuition or along traditional 
lines rather than on the basis of factual knowledge. The following specific 
qualitative factors should be considered by acquisition managers as they 
affect both the hardware and- the training portions of all programs: 

• Cost Data Records. Cost data should be divided by category with 

each covering a major element of the acquisition program. Individual 
cost items, regardless of the source of funds, should be recorded 
within their element and one central file of all costs maintained 
/ readily available to the decision makers. Thus, the record of all 
training costs would be maintained as a subelement under .Integrated 
logistics Support {ILS), regardless of who ordered and who funded 
the training. 

; • Historical Data Records. The, need to trace the source and reason 
for a giVen decision frequently arises. Such Information can have 
a profound impact on future decisions, particularly when the original 
decision makers and/or their rationale are not available. Project 
managers should consider the establishment of a central file of 
historical data, to include the. rationale behind specific decisions, 
similar to the one proposed for cost data. 

SUMMARY ■ ■ - ' . 

In addition to the cost factors addressed in the previous section, non- 
cost, or qualitative factors, which must be considered by decision makers^ 
were identifieji. These were divided into two major categoriesj 1 .e. , quallta- , 
t1ve factors relevant to the cost management control procedure and general ,, 
qualitative factors. 

The first, factors affecting cost management, are specific in terms of 
thetr influence on program costs. Seven individual areas were identified. 
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The second, general factors, were nonspecific In nature and tended to have 
influehce on all aspects of the acquisition program as well as the training 
process. Three major areas were identified as deserving of the acquisition 
manager's attention. 
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SECTION IV 
CONCLUSIONS AND RECOMMENDATIONS 

This section contains 'conclusions concerning current policy, practicas* and 
procedures affecting initial training in major surface system/equipmant acquisi- 
tions and recormendatlons for improving the overall efficiency of initial 
training management. These conclusions and recownendations are derived from two 
sources of information: (1) data contained primarily 1n the body of the report, 
which is specifically applicable to the development of the proposed cost manage- 
ment control procedure and (2) that Information. and supporting data contained 
primarily 1n the appendices and which Is applicable to Initial training In the 
more general sense. This distinction Is reflected, Itv the organization of this 
section. Areas which require additional Investlfatlon are identified when 
appropri ate , 

CONCLUSIONS AND RECOMMENDATIONS: COST-MANAGEMENT CONTROL PROCEDURE 

. 1* Satisfactory training has resulted from the use of each initial train- 
ing alternative; i.e,. Navy prepared and presented, contractor prepared and ^ 
presented, or some mix thereof. Howeveri available evidence was not sufficient 
to prove or disprove the training effectiveness or economic advantage of one 
alternative over another for a given situation. 

2. The efficiency and effectiveness of initial training programs are 
frequently functions of the persbnal experience of the Individuals managing the 
programs* This is primarily due to the fact that a central repository does not 
exist which processes, stores, and disseminates historical management and cost 
data for Initial training programs. These data would be valuable to acquisition 
managers in selecting among initial training alternatives and in the day-to-day 
management of initial training programs, 

RecoCT ie ndation r A central repository should be festablished for the collec- 
tion, storage, and dissemination of all initial training historical managefnent 
and cost data,, General purpose, commercially available computer systems should 
be used for the processing and storage of data. Standard formats should be 
developed for input and output data and made readily accessible By acquisition 
managers for use In the decision making process. 

, 3, ^ A precise standard method 1s needed for developing Initial training 
budgetary cost estimates and for evaluating contractor initial training cost 
estimates, 

Reconmendation : Further' development of the cost management control proce- 
dure n lustra ted 1n section, II of this report 15 recommended. Particular emphasis 
should be given to the labor cost category area which Includes labor distributioni 
classification, and utilization relationships. A statistically valid sample of 
actual negotiated contractor iriiti^^^^ining cost data should be collected. 

a. Utilization of the data collection instrument presented in appendix 
E 1s recommended for all initial training procurement solicitations. This 
instrument includes all MIL-STD-1379(A|^ requirements but requiris validation and 
revision as necessary. \ . 
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b. The sample cost data summary presented in appendix F should be 
evaluated using actual contract cost data and revised as necessary. The use of 
actual contract cost information will provide data that can be used by acquisition 
managers In the preparation of budgetary estimates and in contractor proposal 
evaluations, 

4, Contractor Initial training technical and cost proposal submissions 
are normally evaluated by the acquisition manager* Training community personnel , 
familiar with instructional procedures and the development effort required for 
various types of Initial and follow-on training requirements, do not normally 
participate in this function/ ■ 

Recommendation : Formal procedures should be developfd and implemented to 
increase participation by and utilization of training cor^and personnel 1n all ^ 
major elements of the ^Initial training process. Training. coimiunlty participation 
would permit utilization of existing training expertise, allow for coordination 
of delivery schedules, reduce delays in the overall evaluation cycle, and prevent 
future misunderstanding regarding training package requirements, A precise 
definition of responsibilities and assignments early in the program would mitigate 
these management problems. / 

CONCLUSIONS AND RECOMMENDATIONS: GENERAL INITIAL TRAINING 

- /■ ' ■ ' - ' 

5, The provision of initial training for complex and diverse types of 
systems/equipment is a sophisticated, highly variable process not conducive to 
comprehensive examination on a short term and/or limited data basis. 

6, The relationship of iriltial training to manpower allocation and assign- 
ment, hardware acquisition, funding procedures^ and simnar areas involves 
numerous commands. These commands may have interests that are not always com- 
patible. Since initial training and manpower actfons originate with the 
acquisition command, a study concerned with these broad relationships is most [ 
appropriately, performed by the acquisition coninand, with Inputs solicited from 
all affected commands and activities. 

Recormiendatlon : Information and procedures contained in this study should 
be used as the basis for follow-on Investigations Into the initial training 
process and its relationships with areas such as manpower allocation, hardware 
acquisition, and funding. These future investigations should be coordinated at / 
the OPNAV level and conducted by appropriate hardware acquisition command(s) 
with input from affected comnands and activities (e,g,, CNET,^ NAVPERS, etc,)* 
It is further recommended that future investigations use data acquired through 
the actual tracking of a representative sample of new acquisition programs 
from the time of OR approval through CNET acceptance of the initial training 
course. 

J. Training and training related functions are, by and Jarge, viewed as 
being of secondary importance to actual hardware in the acquisition process. 
Consequently, resources are often allocated to accommodate othec (usually 
hardware) goals with insuffidlent attention to the effects of these actions 
upon future hardware training requirements. 
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8. Existing directlvis are explicit in their definition of initial train- 
ing policy and procedures. However, in sortie Instances this expllcitness places 
unnecessary constraints on prpgram managars. Broad policy directives would 
permit prograrn managers greater flexibility in dealing with every day management 
problems. 

Recommendation : Existing initial training policy directives should be 
reexamined and revised to eliminate program management constraints which impair 
management flexfblTlty, 

9. Coordination of initial training requirements between the Training 
Support Agent (TSA) and the Training Agent (TA) (which should begin early In the 
planning phase and continue through acceptance of the training package) is a ^ 
critical factor. This coordination frequently does not coniiience until iSte in 

the development phase. Complications arising from this practice include scheduling 
delays, ineffective tralhing packages, costly redevelopment effort, inefficient 
use of available resources and management problems, 

10. Long term cost avoidance may be realized If Initial training resource 
allocation (funds and personnel) is made larger earlier in the acquisition 
cycle. The Increase in program efficiencies and the quality of completed initial 
training programs may offset losses from fund expenditures on programs that are 
cafjcelled at some- pqint in the cycle. 

Recommendation : An investigation should be Initiated to determine the 
benefits which might be derived by an allocation of resources for initial train- 
ing prior to Milestone 11 (Full Scale Engineering Development), so as to involve 
affected commands/activities earlier in the acquisition cycle. The study would 
determine whether or not the annual costs for initial (planning) work on programs 
not implemented (effectively, a loss) would be different from the annual savings 
that might occur for programs implemented that can be attributed to -the early 
coordination efforts by affected conmands/activl ties (effectively, a cost 
avoidance). 

.11. The Ship Acquisition Program Manager (SHAPM) for a ship acquisition 
program usually assumes total responsibility for PRECOM, training, including 
Initial training, regardless of who developed the individual equipment or 
system. Equipment/system acquisition managers often addre&s the equipment/ system 
training for which they are responsible Independently from the PRECOM training 
package. These practices can result In inefficient program integration and a 
duplication of training with consequent cost escalation. 

12. Every Initial training requirement should be examined on an individual 
basis with both quantitative and qualitative factors taken into account in 
determining who should develop and present the course. Traditionally, acquisitions 
that involve a high percentage of advanced technological effort have required 
contractor developed initial trainlngr acquisitions based primarily on existing 
technology and/or lower percentages of advanced technology may use Navy or a 
Navy/contractor mix for Initial training development. However, these general 
guidelines may not hold true in all cases. , , 
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13. Some acquisitions use Training Review Teams (TRT), composed of represinta 
tives from involved commandSj to perform periodic initial training course develop- 
ment reviews. These teams can be an effective management control agent, enhancing 
coordination among commands in terms of course requirements , program schedules i 
data packages* and resource distribution. 

ReconiTiendatiQn : The use of Training Review Teams may be appropriate in a 
variety of situations, including both large and small acquisition pfograms* 
However, under some conditions, the use of these teams may not be eqQncmlcally 
defensible in terms of funding or manpower requirements* InvestTgation of the 
appropriate conditions wherein the use of TRTs is economically feasible is 
warranted* 

14. In major acquisitions, the intangible benefits of experience, continuity, 
program familiarity, and morale may be lost because of the sea/shore rotation 
policy affecting Naval personnel. The value of such intangibles should be 
considered when selecting military personnel to participate in the development 

of initial training. 

Recommendation : The Training Comand should develop and maintain a core of 
specialists, both military and civilian, whose technical expertise has been 
developed through participation in, the training elements of major acquisition 
programs. Specificany, a career path for. Naval personnel should be devaloped^ 
that would provide shore duty (within the training cofTDiand) emphasizing acquisi* 
tion program/initial training expertise, interspersed with operational assignments 
within warfare/career fields. 

^ 15. All initial training courses should be procured 1n accordance with the 
requirements of the one contractually acceptable standard by all acquisition 
commands. Internal cormand directives may not necessarily be contractually 
acceptable and may cause program delays and cost Increases. 

Recommendation : MIL-STD 1379(A) is recoimiended as the. single standard upon 
which all initial training programs are developed. 
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AB 
AT 

Balance Criw 
Training 



CIWS ■ 

COMBATSYSTRAGRU 

CNET 

CNTECHTRA 

OSARC 

FB 

Fol Tow-on Training 
ILS 

InltlaT Training 



LBTS 
MCON 
NTEC 
NTP 
NTPC 
*NTU 

Nucleus Crew 
Training' 
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.DEFINITIONS AND ACRONYMS 
Anocatid Baseline 
Acceptance Trials \ 

Training given to nonnucleus crew .personnel assigned to' 
fill-out assigned complement/allowance of initial ships/ 
acqulsitions/tqulpments. Conducted at a training center^ 
(which may be onsite or separately located); emphasis is 
on grpup/teani training, with Individual training provided> 
en route if required at a school house. | 

Close In Weapon Support 

Combat System Training Group 

Chief of Naval Education and Training 

Chief of Naval Technical Training 

Defense System' Acquisition Review Council 

Functional Baseline 

Any training conducted subsequent to initial training 
Integrated Logistic Support 

Training provided for the first ship, system or equipment 
of a series. Also, that training, usually provided by 
the TSA, performed pending the opportunity for the TA to 
acquire the capacity for such training. 

Land Based Test Site - , 

Military Construction 

Naval Training Equipment Center ' _ 

Navy Training Plan 

Navy Training Plan Conference 

Navy Training Unit 

The training of the 1st (and Znd, if required) .increments 
of officers and men who are especially selected specialists 
and who will initially man designated systems aboard/ 
reUted to new acquisitions/equipments. Usually performed 
onsite. Usually emphasizes individual (vice team) 
training, In both operations and maintenance areas. 
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OR 

PB 

POA&M 
PRECOM 

Preconnilssloning 
Training 



SHApM 
SWOS 

I 

Trjalning Agency 



TAEG s 
TSA 

Training Support 
Agency 



Operational Requlrenient ' ■ 

Product Baseline ■ - • . 

Plan of Action and Milestones 
Pricommlsslonlng " ' 

The process of assembling, organizing,, and training the 
officers and men comprising the crews of ships (and other 
water-borne craft) being placed In conmlsslon or^1n 
service. Training as needed, or required/ordered by the 
PGO. Included are: (1) preparation of coimilssloning, 
(2) dockslde trials, (3) f^st cruise, |4) underway trials. 
(5) ready-for-sea training, (6) qualifications and special 
tests, ;ind (7) shakedown training. Individual, group and 
team, scihool house, onslte, watch and GMT training are 

Included. . , 

Ship Acquisition Program Manager 
Surface Warfare Officers School 
Training Agency 



Any office 
command of 
of the Dep 
Res pons ibl 
equipment 
Training ( 
Supervises 
personnel . 
timely 1ns 



bureau 1 conmands or htadquarters exercising 
and providing support to some major increment 
artment of the Navy formalized training effort, 
e for training^ including factory training on 
no longer in productions or where Initial 
related to factory training) haii been completed, 
and regulates training programs for military 
Furnishes training requirements to TSA for . 
ertlon In programming and budgeting system* 



Training Analysis and Evaluation Group 
Training Support Agency ' s 

An office, bureau, coniTiarid, or headquarters responsible 
for supporting the Training Agency's (TA) by providing 
material and other fonns of support within the cognizance 
of the offices bureau, on conmiand Involved.^ Responsible 
fqr factory training of civilian personnel and the 
initial training of personnel assigned to fiew acquisitions , 
equipments s or systems. 
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LIST OF COMMANDS And ACTIVITIES CONTACTED 
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LIST OF COMMANDS AND ACTIVITIES CONTACTED , 

Chief of Naval Operations (OP-39, OP-099), Washington, DC 

Commander Naval Sea Systems Command, (Sea 0243, Sea 047. Sea 653, Sea 654, 
PMS 301, RMS 306, PMS 377, PMS 378, PMS 399, PMS 404h Washington. DC 

Chief of Naval Education and Training (N-31 , N-S), Pensacola, 

Chief of Naval Education and Training Support CN-4), pansacolaj FL 

Chief of Naval Technical Training N-43), Mlllington, TN 

Service School Conmandi Great Lakes, TL . 

Surface Warfare Officers School, Naval Education and Training Comnand, Newport, RI 
Land Based Test Site, Sperry S)^stem Test Center, Long Island, NY 
Naval Training Equipment Center, Orlando, FL 
Combat Systems Training Group, Mlllington, TN 
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' / AN ILLUSTRATION OF A COST ESTIMATION PROCIDURE FOR 
' . NAVY DEVELOPED INITIAL TRAINING: 

This appendix presents selected discussions from TAEG Technical Memoran- 
dum. 77-5. Preconinlsslon lng Training , to mustrate the procedures used to 
estimate the cost of the Navy developed and Implemented Combat System Maintenance- 
Management Training (CSMMT) for the CGN-39 (USS TEXAS). It Is concerned only ' 
with procediires for estimating Navy developed initial training costs, therefore, 
the- procedures presented In TAEG Technical. Memorandum 77-5 for estimating 
contractor Initial training fcosts are not included here. The cost estimation 
procedures inustrated in this appendix can be adapted for any NaVy developed 
Initial training program, and. when used in conjunction with the contractor 
cost estimation concept presented in the main body of _the report, provide a 

viable method fo.r cost cqmparison of the. two aHernatives . 
BACKGROUND . 

' ■ ■ ■ ' 

The 'cSMMT course for the CGN-38, the first ship of its class, was developed 
and conducted by Control Data, Corporation (CDC) under Contract N-00024-74C-0230 
with the Ship Acquisition Program Manager (SHAPM) {PMS-378). Follow-on 
training for the CGN-39 and remaining ships in ,the CGN-38 class would normally 
have been provided. by appropriate Navy activities i however, the following 
bombiriatlon of CGN-38 related events prevented this normal follow-on. training 
cycle for the CGN-39 from, taking place. , . \ 

1. The contractor conducted CjSMMT course for the CGN-38 was not satis- 
factory, primaflly due to inadequate documentation, and was not acceptable to 
the Chief of Naval Technical Training (CNTECHTRA). 

2. The Combat System Maintenance Training Facility (CSMTF), Mare 
Island, was not complete and did not have the capability to provide CSffIT .for 
the CGN-39. 

3. The contractor's estimate of $200,000 (reference Chief o¥ Naval Air . 
Technical Training Itr Code 7012/RWS:mbm of 27 December 1976) to develop and . 
conduct a CSMMT course for the CGN-39 was considered excessive. 

These events led to the SHAPM and Chief of Naval Operations (CNO) decision ./ 
to task and fund the" Combat Systems Training Group (COMBATSYSTRAGRU) to 
, develop and conduct a CSMMT course for the CGN-39. This Group was composed, 
of highly experiericetl personnel unfquely qualified for the task. The^CSMMT 
course and a modified versiqn of this course were successfully presented to , a 
total of 70 students during the periods October through December 1976 and 
Jarfuary - February 1977. They were .given in Navy control led 'facilities at 
Newport News, Virg'inia.' > 

METHODOLOGY . ■ " 

Data necessary to develop an estimate of the Navy's costs for the development ^ 
and implementation of the CGN-39 CSMMT course were obtained from the COMBATSYSTRAGRU 
personnel. Bureau of Naval Personnel Bniet Cost Model (1975), and the General 
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Services Salary Schedule (1975). The concepts and procedures of economic 
analysis set forth in TAEG Report No. 11, A Primer on Economic Analysis for 
Naval Training Systems , (Swope, 1976), were foil owedTin developing the cost 
estimate for the CSMMT program. No attempt was made to Identify and compare 
the real benefits of the training courses, such -as improved job performance 
through reduction in accident rates, downtime, equipment failure, etc. Such 
detailed analysis was beyond the scope of this effort; however, such factors 
should be Included as an integral part of future cost estimates fpr Navy 
developed Initial training programs. 

NAVY DEVELOPED CQN-39 CSMMT COST ANALYSIS 

The 'development and implementation costs for, the Navy developed CGN-39 
CSMMT were determined 1n a somewhat different manner than the costs for 
contractor developed CSMMT. This procedural change was necessary to acconmodate 
the type of data available for analysis; however, the procedural difference 
does not detract from the validity of the Navy cost estimate or the comparability 
of these training costs with contractor developed initial graining costs. 
The formula (development and Implementation) upon which- this cost analysis is 
based is: . . 

TOTAL COST ^ F + E + IMD + P + S + ST + M 

FACILITY COST , 
EQUIPMENT COST 

iNSTRUCTIONAL MATERIAL DEVELOPMENT COST 
PERSONNEL COST 
SUPPLY COST 
STUDENT 'COST 

MISCELLANEOUS COST > ' 

1. Specific Assumptions : 

a. The development facility 'had no real worth as It had exceeded, 
its life expectancy and was scheduled for razing. 

b. Development equipment had no real worth as 1t had exceeded Its 
life expectancy. 

c. A man-year consists of 2,080 hours for purposes of converting 
yearly salaries to hourly rates. 

d. Twenty-five percent of the CGN-38 CSMMT course was' usable in, 
the Navy developed CGN-39 CSMMT course. 

e. Personnel costs for Naval personnel are burdened; civilian 
Naval personnel costs are not burdened. 

,2. Given: (Based on .COMBATSYSTRAGRU Data and Assumptions) 



WHERE F = 

' ' E = 
IMD = 
P^ 

. S ^ 
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DATA ITEM 



DEVELOPMENT 



IMPLEMENTATION 



1. Average Professional Rate 

2. Average Clerical Rate 

3. Total Professional Hours 

4. Total Clerical' Hours 

5. Total Facility Area 

6. COMBATSYSTRAGRU' Facll 1 ty Area 

7. Facility Maintenance Cost/yr. 

8. Facility Utility Cost/yr. 

9. Supplies 

lb. Support Cost 

IT. CGN-38 CSMMT Development Cost 



$12.649/HR' 
$,4.343/HR 
5,025 HRS 

347 HRS 
11,088 FT2 

750 FTZ 
$ 8.175/YR 
$ 9,500/YR 
$ 644 ' 
$ 6;Q83 
$191,827 



$12.722/HR 
$ 4.343/HR 
2,426 MRS. 
0 

NA ^ 
- NA 
NA 
NA 

$1 ,258 
$8,210 
NA 



\ 



3. Deyelopment Cost Computations : 



b. 
c. 
d. 



category. ) 



e. 

f. 



- MAINTENANCE + UTILITY COSTS . 

M$8.175 . $9,600)(y^,XTT%STT2) 

- ($17,675) (.583) (.068) 

= $701 ■ . ; 

= 0 „ ' , , 

IMD = $6,083 . 

p' ^ TOTAL HOURS X AVERAGE LABOR RATE 

" (1) PROFESSIONAL = 5,025 HRS X $12.649/HR - $63,561 ' ■ 

(2) CLERicAL ' - 347 HRS X $ 4.343/HR « 1.507 

■ : , P * $65,068 

„ S ^ $644 ' 

ST = 0 

M = Q (No actual expenditures could be Identified for this 



ERIC 



46 

49 



This cost analysis' Is based on the 1dent1n^at1on of the total actual ' - 
costs Incurred or avoided by tht Navy in the developmint of the CGN-39 CSMMT 
course. .However, 1t is apparent from the study Investigation that the contrac- 
tor's CGN-38 CSMMT course material and developmantWfort provided a significant 
contribution to the COMBATSYSTRAGRU's timely and suctessful development of the 
CGN-39 GSMMT course. The COMBATSYSTRAGRU estimated t^at 25 percent of the 
GGN-38., CSMMT course material was used, and thus this aniount of development \ 
effort was avoided in the development o( the CGN-39 GSMMT course. This means 
that in terms of time and monetary savings/ the C6N-38 CS^MT program was of 
value to the COMBATSYSTRAGRU, and this vaVue must be qonsi^ered. in decisions 
regarding the cost. 

Technically, a monetary figure representing the value. o^ the CGN-38 CSMMT 
program should not be included in a cost analysis concerned with tha. total 
actual costs incurred in the development of a training course.. Hbwever, the 
Navy developed CGN-39 CSMMT course represents a unique situation with broad 
implications for ^future initial training programs* Thie study investigation 
suggests the importance of recognizing all cost consldlratioris to include the 
avoidance .of cost value of th# CGN-38 CSMMT course tp/.the CGN-39 CSMMT course 
development effort. Failure. to include this valutf (Ipe. , monetary avoidance 
to the CGN-39 CSMMT, course development effort) of the CGN-38 CSMMT program tn 
^the total cost computation of the CGN-39 CSMMT course development effort would 
create a misleading baseline for future initial training program decisions. 
The impact* in^ terms of- estimated valui, of the CfiN-3B program was signifi- 
cantly relevant to tHf totaT cost to the Navy.;4 For this reason| a deviation 
from standard cos,t analysis techniques 1s^ justified and the estimated cost 
avoidarfce value of the CGN-38 CSMMT program is included in the total cost of 
the Navy developed. CGN-39 CSMfiT course* The actual total Navy eKpenditure 
for the CGN-39 CSMMT Course 1$ determined by subtracting, the Navy avoidance of 
costs of development of the CGN-38 "CSMMT course from the total costs presented. 

'GN-38 Value = (CGN-38 Develofinient Cost plus Material Cost) 25% ; 



= (191 ,827 +,,5,390 + (5390 X 23.05%) f (5,390 + (5,390 X 23.05%)), 



(10%)) 25% 
(191,827 + 5^390 + 1,242 + 663) 25% 
• 199,122 X 25% . ' 

' «,$ 49,780 

'h. . TOTAL DEVELOPMENT COST - F + E + IMD + p + S + ST + M 

s $701 +0 + $6,083 + $65,068 + $644 + 
'* ; ' + $49,780 

TOTAL DEVELOPMENT COST = $122,276 

^ Development of these costs 1s described In detail In TAEG Technical 
Memorandum 77-5 (Cordell, Nutter, and Miller, 1977). 
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' 4. Implementation Cost Computations ; 

C. IMD = $8,210 . - 

d. P » TOTAL HOURS X AVERAGE LABOR RATI 
. . ' (1) PROFESSIONAL = 2,426 HRS .X $12. 722/HR ^ $30,864 ' 

(2) CLERICAL = 0 

P = $30,864 

a. S ^ $1,258 ' . 

. . f . ST « 0 , 

g. 0 , 

h. TOTAL IMPLEMENTATION COST * F + E + IMD + P + S + ST + M 

> 0 + 0 + $8,210 + $30,864 + $1 ,2S8 + 0 + 0 

TOTAL IMPLEMENTATION COST ^$40,332 , 

5. TOTAL |IAVY CGN-39 CSMMT COST ^ DEVILOPMiNT COST + IMPLEMENTATION COST 

J ^ = $122;276 + $40,332 

^ $162,608 '. 

Comparison of the above total cost with the estimated contractor cost for 
the same effort »led to the apparent conclusion that the Navy developed CGN-39 
CSMMT was the more cost effective. The validity of this conclusion, however, 
had to be weighed in conjunction wltl^; the following facts; 

• Navy civilian labor rates were not/adjusted to reflect a 
burden value as were tne Navy military and projected contractor 
labor rates. I • 

' • No monetary value was attached to the special training (i.e., 
the two Course Development courses) provided to Navy personnel. 

• The Navy cost analysis doei not address whether or not the. 
Navy resources (personnel, facilities, services, etc.) consumed 
to develop and Implement the CGN-39 CSMMT could have, been 
redirected to other uses which miiy have, made a greater con- 
tribution' to the accomplishment of the Navy nfisslon. 
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• , Approximatily 41 percent of the Navy's devil opmiht costs are 
attributed to. the real value realized from the contractor 
developed CSN*38 CSMMT course. This represents a significant 
percentiigt of^the Navy's total cevf^lypi^^^rit cost* 

^ majorf finding derived from the cost analyses presented in TAEG Technical 
Memorandum 77-5 was that each Initial training cise must be treated Individ- 
.ually based on the actual events occurring In that case. The analyses perfonned 
to penult comparison of the contractor and Navy Initial training costs for 
the CGN-38 and CGN-39 were based on a unique set of events not necessarily 
applicable in all acquisition programs. For Instance, Navy facilities used 
during development of the CGN-39 CSWIT had exceeded their life expectancy and, 
thereforer had no monetary value. This Is-a unique situation that will not 
occur In most Navy course developments. Whereas the basic cost estimation 
procedures used to estimate the Navy developed Initial training costs are 
valid, minor modlflcatloni will be required to adopt these procedures to 
accbfiinodate the Unique requirements and situations of Individual Initial 
training programs. 
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SUMMARY OF CASES STUDIED 

This appehdi5& sumfflarlzis'the data acquired for lach of kht cases selected 
for 1n-depth study. Through discussion with Navy personnel kssociattd with 
initial training, the 14 programs listed in table D-1 were identified as candidate 
for case study. Five of the fourteen were selected for in-dipth study. Reasons 
for npnselection of the remaining =9 programs ere given in ta|le D-1. 

Three data elements were researche'd for each case: historical background, _ 
resources available to CNET at the time initial training planning conmenced, and 
the cost of initial training. Two of the tKree elements are 'addressed for each 
case. The third data element, resources available to CNET at the time initial 
training planning commenced, was a "lost cause." In some cas^s. resources did 
exist, usually in the form of personnel available to the Navyj predominately at o 
land based test sites, but they were not under CNET control. I Therefore, in 
terms of course developnent, their usefulness would have been! marginal at best. 
In one case, the 1200 PSI Simulator, an undefined quantity of/ personnel and 
facility resources were available to CNET but were not used./ More importantly, 
however, there was no way of establishing even an approximation of the quality 
and quantity of resources which may have been available for diversion into the 
preparation for initial trainirtg without degrading other Hap requiranents. For 
these reasons no further reference will be made to resource^ which might have 
been diverted into the development and presentation of initial training. 

] Data were gathered in an attempt to establish a seriesUf historical mile- 
Istone charts. These milestone charts were to be used to Identify each of the 
Imajor participants 1n the planning and preparation of initial tr^ining^for each 
\case and their points of entry into the program. The milestone fchart for each 
base was then to be compared with a master milestone chart based on the major 
decision points of any acquisition. Figure D-1 is the master, relative mile-_ 
stone chart. It is based on current, existing directives and relates required 
training actions to major acquisition decision points. 

lata were to be used to: 

Identify and determine the value of all elements classifiable as 
resources required to be expended for each of the initial training . 
programs. ' / ■ 

Compare the actual timing of the Training Agent (TA) inputs In each 
program with the optimum timing of these inputs to determine whether 
maximum use was made of the training expertise available. 

Develop a cost management control procedure which could be used with 
the Navy cost procedure presented in TAEG Technical Memorandum 77-5 to 
compare the cost of using Navy provided initial training. This 
comparison would be one factor used by acquisition managers in making 
the decision respective to who is to develop initial training and who 
is' to implement the training. 
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TABLE D-1. TOTAL INITIAL TRAINING CASES INVESTIGATED 



SYSTEM/ EQUIPMENT 


INFO SOURCE 


TYPE COURSE 


REMARKS 


^ cm 38/39 - Combat 
System Maintenance 
Management 


PMS - 378 
OP - 992 • 
OP - 39 

LUMBATSYSIKAfaKU. , 
CNTECHTRA — 


Maintenance 


Acceptable 


LHA - Engineering 
Consol idated Control 
System 


PMS - 377 
CNTECHTRA 


Maintenance 


Not acceptable. 
Insufficient 

UQ to lUr wUbU 

analysis* No 
historical data. 


1200 PSI Simulator 


PMS - 301 
PMS - 306 
SWOS, NPT , 
NAVTRAEQUIPCtiN 


Operator & 
Maintenance 


Acceptable 


FFG - 7 ■ . 
Ship's Service Diesel 

Generator 


PMS - 399 . ' 
P.E. Sch. , 5SC, 
Great Lakes 
CNTECHTRA 


Maintenance 


Acceptable for 
historical purposes, 
Not acceptable 
ror costing* . uata 
not 1n a usable 
format & Incomplete. 


FFG - 7 
GFCS MK 92 


PMS - 399 
NAVSEA 653 
LBTS, LI, NY 

Lri 1 tLn 1 KM 


Maintenance 


Acceptable 


CIWS System 


PMS - 404 
NTU 

CNTECHTRA 


Maintenance 


Not acceptable. 
Data could; not be 
broken-down into 
Increments. 
Historical recaDS 
not a^vatlable* 




CNTECHTRA 


Maintenance 


Not acceptable. 
Initial training 
will be a different 
course In late 
CY 78, 
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TABLE D-1. TOTAL INITIAL TRAINING CASES INVESTIGATED (continued) 



SYSTEM/EQUIPMENT 


INFO SOURCE 


TYPE COURSE 


REMARKb 


Weapons Officer 
Course 


CNTECHTRA 


Operator 


Not acceptable. 
No equipment 
Involved*. Not 
appropriate for 
this study* 


MK .86 MOD 8 
GFCS 


CNTECHTRA ' 


Maintenance ^ 


Not acceptable. 
No development 
effort yet for 
initial training. 


AN/WSN-2 Gy»o 
Compass 

Types I and II 


NAVSEA - 047 
NAVSEA - 0243 
NAVSEA Plant Rep. 


Maintenance 


Not acceptable. 
Cost data not 
broken into cate- 
gories* Single 
price bid made 
and accepted. No 
histortcal data* 


AEGIS 


CNTECHTRA 


Maintenance 


Not acceptable* 
A NTU has been 
established but 
has prepared no 
courses. Too 
early In program. 


400 HZ Solid State 
Frequency Converter 


NAVSEA - 047 
CNTECHTRA 


Maintenance 


Not acceptable. 
^ Too early in pro- 
gram* Evaluation 
not scheduled 
until CY 79* 


MK 62 MOD 16 

GFCS 


CNTECHTRA 


Operator 


Not acceptable. 
Initial training 
scheduled for 
late CY 78, 


FFG - 7 

Central Control 
Station 


PMS - 399 
CNTECHTRA 


Maintenance 


Not acceptable 
for historical 
purposes. No 
records. Accept- 
able for costing. 
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Acqiiisltion 
Eyint 



i iiiii 



Training 
Event 



FB 



DSAELII 



DSARLJII 



AT 

Delivery 

lit 



Conceptual 
Phase ' 



Validation 
Phase " 



Engineering 
" Phaie 



Pfoduction 

- Phase— ^^-^ ^ 



T 



mm 



=3 yrs (Mi 



1*1 .yr^ 



yrs" 



HCON 

Entry 

(Htn) 



Trng NTPC NTP ■ 

DavicB (Aytharize! 

Entry Training).' 

(Min) . 



Initial Del AT 

Tfiig 

Tfng 

Sys 

Cpnip. 



] 



Identifies fixed point in Vim. 



OR (Opirationa] Riq-jlraiient) 
FB (Functional BisiMne) 
AB (Allocated Oaseline) 
PB (Product liaseiifie) 
AT (Acceptance Trials) 

DSARC (Oifanse Sysien Acqyisition, Review Council) 

NTPC (fiavy Trainiri^ Fian Conference) 

NTP (Navy TrainingAPlin) 

ILS ( Integrated Logistic- Support) 

HCQN (miltarv Construction) 

DEL (Delivery) 



Figyre D-U ^Mastir Hilestone Chart Showing Relatjonship of Hajor Training 
pieiiion Points to Hajor AcquisliWOacision Points 



REMARKS 



Systefii delivery and AT an 
conildered to be laro titni 
with all othif timi' ipans 
nieiiurid rilatlvi to this 
point J 

Tline betwiin thi OR and 
appfoved FB at DSARC I,, 
approved PS at DSARC III, 
and deli very and AT is 
yifiabli ffORi pfogriRi to' ; 
.prograni. 

Pubiilhed NTP riqulred 
at liast 3 years prior to 
delivery. NTPC required 
to occur no fDofaithan 
90 days prior fo issuance 
of approvid NTP". DRAFT 
NTP required to be issued 
at least 30 days prior to 
flTPC. 

NTPC usually occyrs 
shortly after DSARC II 
because, with approval 
of the AB, development ■ 
funds are released. These 
funds include ILJ funding 
of which training is a 
fnajor lubeieiiient. 



tlfne for budgetary 
subdilsslons for inajor 
training devices is 4 years 
prior to ready for; train- 
ing date*. 

MlnlM tlfne.for budgetary 
sutaiission for flCON is B 
years 'prior to beneficial 
occupancy date* 
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- The rpmainder of this appendix 1s devoted to the presentation'of -the 
data acquired for each case study. Each case includes a subsection on History 
and Initial Training Costs. Only the CGN-38/39- case study was supported with 
sufficient data to warrant inclusion of an analysis subsection. Data for the 
remaining case studies was so limited that comprehensive analysis was impossible. 

CASE I. CGN 38/39 COMBAT SYSTEM MAINTENANCE MANAGEMENT (CSMM) INITIAL TRAINING 

Complete details of. this case study- are contained in TAEG Technical 
Memorandum 77-S, precommissioning Training , dated July 1977. Consequently, 
only a sunmary of relevant data will be presented here. 

HISTORY The CGN-38 Ship Class 1s basically a modified version of the existing 
OLON 36/37 ship class which had previously been acquired by the Navy. For . 
the CGN-38 class there was no Operational Requirement (OR) per se, nor a 
Defense System Acquisition Review Council (DSARC) I or IL. Rather, the class 
was authorized by a Ship Acquisition Plan (SAP) in October 1968. DSARC III , 
occurred in 1970, and this was followed by a DSARC IIIA in 1971. Delivery of 
thn first ship, CGN-3B, occurred in August 1976 approxirtiately 6 years after 
the Production Phase had been authorized. 

The first documented planning" for an initial training course in CSMM 
resulted from the NTPC held in May 1970. A preliminary Navy Training Plan 
(NTP which resulted from the conference, was Issued in August 1970. The 
first'approved NTP was dated. May 1977. However, CSMM Initial training planning 
for the CGN-38 Class proceeded on the basis of the preliminary NTP. and its 
revisions. Actual initial CSMM training for the first ship was presented by. 
the contractor during the months of October and November 1.975. 

The CSMM course presented by the contractor to the CGN.r38. crew was not. 
satisfactory because it lacked the depth necessary , for use in CSMM. It did, 
however provide useful information for system Indoctrination of Jumdr ' \ 
technicians.- The course lacked the required depth primarily because course 
developers were unable to bbtalndata on the integration of the many sub-, 
elements of the system controlled by the integration computer prior to corn- 
pletion of course devel opment. The anticipated contractor's cost to revise 
this course for the second ship of the class, CGN-39, was considered to be ■ 
excessive After considering tt^e alternatives, the Ship Acquisition Program 
Manager (SHAPM), who was also the Training Support Agent (TSA), requested & 
Navy command, the Combat System Training Group (COMBATSYSTRAGRU) , to revise 
and^oresent the course to the CGN-39 crew. This second course was considered 
to be a part of initial training since the Training Agent (TA), CNET, could 
■not accept --sponsibil i ty for CSMM training until the TSA could orovide an 
acceptable course. The COMBATSYSTRAGRU developed and presented an acceptable 
cniirse to the criN-39 in 7 months. 

The COMBATSYSTRAGRU had become operational in January 1974 for the 
Durpose of examining the training in combat systems maintenance. As an 
additional duty the COMBATSYSTRAGRU prepared and evaluated a proposed new 
combat system organization for combatant vessels. The Group was stable from 
its foundation In 1974 through its disestabl ishment in mid-1977. When tasked 



TAEG Report No. 68 



in February 1976 to develop 'the CGN-39 CSMM course, this group could, be 
considered experts in the field of combat system maintenance, with more 
diversified experience than any other group within the Navy and probably 
within the industrial community. This is considered a unique situation 
atypical to most acquisition programs, ■ 

The milestone chart for the CGN-38/39 Initial Training, figure D-2, 
depicts the entry points of ,the various commands and critical events which 
occurred" during the development and presentation of the- CSMM training courses' 
for the CGN-38. and CGN-39. 



SAP DSARC 



DSARC SAP 
III^ UPDAT^' 



CGN-38 
DELIVER 



68 



70 



71 



. CALANDAR YE^R 

I- 

72 73 74 



75 



76 



77 



ILS 
PLAN 



NTPC I 
' NTP 

PROMULGATE CONTRACT 
FOR 
INITIAL TRG 
CGN3B= • 



CBSTG* 
OPERATIONAL 



CGNSsf^ ^NTP^ 

CSE II APPROVED 
CBSTG 
TASKED 

CGN39 
CSE ' 

NTP 
UPDATE 
(FINAL) 



*CBSTG - Combat System Training Group ( COMBATS YSTRAGRU) 

Figure D-2. Milestone Chart for CGN-38/39 CSMM Initial Training 

INITIAL TRAINING COSTS. For the CGN-39 initial training, the actual Navy costs 
were $162,608 against a projecteJ contractor cost of $200,000. Thus an apparent 
cost avoidance' of S37,392 was reilized. The total program cost avoidance, 
however, is apparent rather than actual. First, no general and administra- 
tive cost (G&A) are included, anJ, second, the facilities used had exceeded 
their life expectancy and were scheduled to be razed; therefore, there were 
no Navy facility costs (other thin building maintenance and operation). 



Actual contractor costs for initial training presented to the CGN-38 
were broken into development corts (81 percent) and implementation costs (19 
percent) . . 
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A breakdown of the Navy costs indicates that the development cost for 
the CGN-39 course was 75 percent and the implementation cost 25 percent of 
the total cost. The projected contractor cost breakdown for the CGN-39 
course was 79 percent for development and 21 percent for Implementation. 
Thus, the greatest proportion of the CSMM course costs lay in the development 
area. Therefore, any significant cost avoidance to the Navy would lie in 
this area. Further examination of the development area reveals the greatest 
percentage of the development cost is attributable to labor effort. Jhe Navy 
developed CGN-39 course required 5,025 devteloprtterit hours and the projected 
contractor hours .for the CGN-39 was 7,160 hours. Thus, the Navy was expected 
to use 2,135 fewer hours in the development which; at an average rate (1977) 
of $12,65 per hour, equates to $27,000 without including GSA profit. 

ANALYSIS. Over a 2 year period there had been developed within the Nivy a 
high degree of system and equipment expertise in the arcia of cumbat systems 
and .the maintenance of these systems* However, the integration computer for 
this parttcular combat system was new to the Navy team. Naval Rersonnel 
required some contractor training and dettned documentation on the Integra- 
tion computer in order to become fully qualified in all aspects of ?,ystem 
maintenance. This training and documentation we^e provided, and the cost is 
included in the develooment costs of th^H CGN-39 course. Actual course develop 
ment was acconpliihed in 7 months by four professionals assisted by a single, 
part-time itym I'.. ^ ^ ^ 

The CRN-3B contractor was tasked for CSMM initial training In December 
1971, approxf.'^ateiy 3-3/4 years prior to the course' convening, date. The 
training contractor was not the system designer; therefore, he was required 
to develop ar 1n-house system expertise in order .to prepare the course. 
Because the integration computer documentation was Ute,' the training con- 
tractor was unable to provide a sat^"'^^actdry initia' training course. The 
contractor who devoloped and prepenwod CGN^ 38 initial training was prepared, 
to updatn the A^.P!\-3B initial traihing cojrse corfflnencing approximately 9 
months prior to the course convening date for the CGN-39 cr^^w. An examination 
of the times Involved (see figure .)-2) reveals that there was adequate time 
for the iiavy to have acquired the trained p^^rsonnel to develop and present 
the initial training for the CfiN-38 had they conFienced dGVelopnient effort at 
the time the training contract was awarded, tven though the Navy developed 
and presented the second CSMM training course to the D"N=39 crew at a cost 
avoidance of 19 percent (refer to TAEG Technical Memorandum 77-5), it is not 
Icgical to assume that the Navy could have realized similar savings In the 
preparation and presentatir^; the original CGN-38 course. The ratiop:Je 
for this statement is base-' on the fonowing iritangible factors which mui't 
have been considerad by the ts/, in conjunction with the prospective TA. 
Other factors may also have hac^ to be considered.^ ' 

9 The N3yy*s shortfall; i.e», lack of knowledge of and documentation 
on the intC'gration computer, was identical to the contractor's, 

• Serious consideration would have to have been given to the loss of 
training resources during the extended period of time required to 
— ^ davalop and present the. course. Could the training conwiunity have 
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afforded to assign specialists to the combat system thereby losing 
their services in other areas? 

■ • Should the expertise not be available within the training community, 
could adequate people have been obtained for the requisite period 
from the operational forces without degrading operational readiness? 

• This project would have required the assignment of Naval personnel 
well in advance of the training conmencemerit date. Very nearly 3 
years lapsed between the Contract award date and the ready for 
training date. The gea/shore rotation policy would rionnany preclude 
retention of Naval personnel within, the,, training cpmnand subsequent ' 

- to their being trained as experts . 

A comparison of actual contractor CGN-38 initial training development 
costs against estimated Navy development costs for the same course was desired. 
Unfortunately, sufficient historical Navy course developent data was not 
available upon which to base estimates of required Navy effort. However, 
based on experience gained during the study and upon discussions with knowledge 
able personnel, it appears likely that such a comparison would have, indicated 
very little difference between Navy and contractor course development costs. 
If one presumes that this would have been -the case, and considering cost 
alone as the determining factor, 1t may not have been cost effective for the 
Navy to develop the C6N-38 initial training. However, in terms, of the solution 
to the personnel problems faced by acquisition managers, the potential benefits 
to be derived during fol Inw-on ,and replacement training, and the availability 
of a cadre of combat systems tfained specialists who could be used in .subse- 
quent ship acquisltior^ (for example the FFG-7 Class Ship), the acquisition 
manager with advice from the TA and Personnel Manager may have made the 
decision to use Navy personnel to perform the CGN-38 development effort. 

One critical personnel rotation pbl icy requires imphasis. In major, 
multi-year acquisitions, the sea/shore rota'tion of Naval personnel does not, 
norrnany, permit retention of the developed specialists In the training 
command beyond Initial training. Thus, many of the Intangible benefits would 
be lost. Two alternative solutions to this flroblem are presented here although 
other solutions may be available. These and other alternatives yet to be 
developed should be examined for feasibility and^ economic efficiency. 

Assign Navy civil i^'h employees the task of developing the requisite 
' expertise. In this manner the TA (CNET) would obtain and could 
retain a core of experts in various fields. 

• Develop a career path *or NavaT 'personnel in various fields which 
would guarantee shore (iuty in the training command interspersed 
with operational assignments within their career field. In this 
way CNET would be assured 0/ recovering expended resources used to 
develop experts in various fields, the person would not be denied 
the career enhancing assignments, and the operational forces would 
have avanable the most highly trained experts available. 
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CASE IL ^SHIP'S SERVICE DIESEL GENERATOR (SSDG) 

The SSDG acquisition was a part of the total Ship Acquisition Program 
for the Guided Missile Frigate Class, the first of which was the USS PERRY 
(FFG-7); ' Initially, the study team attempted to regard the FFG-7 program as 
a unit, that is, all systems acquired by the SHAPM were to be examined as a_ 
unit of the ship initial training i uquirements. It became apparent that this 
approiich was impractical; the acquisition and initial training for each 
equipment and system were treated independently by the SHAPM. Until ship 
familiarization occurred with both the nucleus and balance crews present, no 
attempt was made to regard initial training as other than system related^ 
therefore,' it became necessary to treat the two cases derived from the rFG-7 
acquisition program Independently, ' ' 

The SSDG was designed for Installation in ships having a central engineer- 
ing control station with no persons stationed in the machinery space. The 
remote control and monitor features are part of an overall plan for reduced 
ship manning. »The maintenance concept is designed to reduce on-bqard mainte- 
nance to a minimum by replacing certain components before failure and by 
scheduling portions of normal shipboard maintenance tasks during maintenance^ 
availability periods. Organizational maintenance is confined to the Preventive 
Maintenance System (PMSh visual checks, and replacement of .components and 
accessories as units or modules. 

HTSTORY. The program was initiated by a Top Level Requirement (TLR) in 
February. T971 / This TLR was accepted by CNO in May 1971 which formally 
initiated the conceptual phase of the program. The TLR, in effect, substituted 
for DCP I/DSARCL DCP II/DSARC II occurred in August 1972, and DCP III 
(without a DSARC III) was issued in December 1975. The approved NTP, issued 
in February 1975, established the training concept. Since the diesel engine 
portion of the diesel generator set had been in cormercial use, but not Navy 
use, for some time, no OPEVAL or TECHEVAL was considered necessary nor was 
one planned. Initial training was to 'be confined to the diesel engine. The ? 
maintenance workload caused by the generator was considered to be so low as 
to impose a negHgible additional workload on the ship's electricians. 

.The first equipment diesel was tested at the contractor's plant. It 
failed prior to Gompletion of the 1,000 hours operational test required, but 
the failure was attributed to equipment external to the diesel engine. 
Pretest was not considered necessary. Subsequently, the equipment was installed 
at ^the LETS, Philadelphia, PA, and failed to perform in this environment. As 
a consequerice; NAVSEA required a retest by the contractor. During this 
retest the engine failed. There remained insufficient time for another test 
prior to installation aboard ship; therefore, the SSDG was installed aboard 
tfy4 FFG-7 without having completed the required 1 ,000 hours operational test. 

■ In January 1976, the TSA (NAVSEA) tasked the Project Director (FFG 
Propulsion System, LBTS,^ PA) to develop the initial training course for the 
SSDG. Since follow-on and replacement training were scheduled to be taught 
at the Service School Command (BSC) Great Lakes, the TSA offered billets to 
the Training Command for instructors to attend the Initial Factory Training 
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course scheduled for March 1976. The intent, was that these personnel would 
assist LBTS personnel in curriculum design. SSC personnel attended two 
contractor courses and, then, in July 1977 conducted an SSC. developed mainte- 
nance course for the FFG-7 crew tt the contractor's plant under contractor 
supervision. Although the SSC, dreat Lakes, was not tasked to prepare a SSDG 
maintenance course, they did so. 

The first ship of the class was delivered in June 1977. FFG-\is 
scheduled f of- delivery in November 1979. The, SSDG was required to be delivered 
for installation 15 months prior to the ship's deli very ^ate. or in August 
1978 for the second ship. Training for the ship's crew was scheduled to com- 
mence at SSC, Great Lakes, in September 1978 for Fleet Introduction Team (FIi) 
and ship's crews. However, the rebuilt engine from the LBTS was not scheduled 
for Installation until January 1979. The major events of the SSDG program are 
sumnarizad in figure D-3. 



DCP II 
ARC II 



£ 



DCP III 



CALENDAR YEAR 
71 ' 72 73 74 75 ' 76 77 



78 



79 



^4 4 +4 



NTPC 



NTPC 
UPDATE- 



NIP 



ILSP INIT. INITIAL 
FACTORY TRG.' 
TRG. 

NTP CANCELLED 
UNDER EFG-7 
NTP 



REVISE 
FFG-7 
NTP 

(Anticipated) 



FOLLOW-ON 
TRG 



TRG. EQUIP, 
TO SSC 



Figure D-3. Milestone Chart for SSDG Initial Training 



INITIAL TRAINING COSTS. At least two training courses were given by contractors 
and anothpr by Naval personnel at a contractor's facility. Inall cases, cost 
for contr.ictor services and facilities were covered by the basic contract and 
could not be isolated. Only supplies and services used in support of one of 
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the courses were costed separately from the basic contract. Thus, 1t was 
impossible to determine the actual contractor's costs to the Navy for SSDG 
initial training* 

Block funding for travel and per diem was uied to cover the cost of 
Naval personnel attending the various courses. These funds are the only 
identifiable direct Navy costs which could be associated with initial training. 
The establishment of a program at the LBTS and the contractor developed 
publications and material used in the cburses obviously did require the 
expenditure of funds , but these costs are included in the basic contract and 
are not separately identifiable. ' i 

In the study of the SSDG it, became apparent that funds were allocated 
for initial training; howeveri the source of these funds and the specific 
purpose for which they were used was obscured in the hardware costs* What 
little information was available was distributed among many commands and 
required an extensive investigation to locate* 

CASE III. MK 92 GUN FIRE CONTROL SYSTEM (GFCS) , 

The FFG-7 contained a number of systems which, from a training perspective, 
are an essentially new technology* The Mk 92 GFCS is one of these systems* 
This system was selected for case study because the first ship of the class 
was operationaU and training for its crew as well as instructors at the Navy 
shore school site had been completed. 

HISTORY. A TLR was established for a light weight gun fire control system 
for the proposed hydrofoil and frigate classes of ships* Based. on this 
requirement, a risk analysis was performed and ah investigation conducted 
into existing systems. A Dutch system, designated 1n the United States as 
the Mk 94 GFCS, was selected as meeting all basic requirements. /An opera- 
tional copy of the Dutch system was brought, to the United States and released 
to a contractor for Americanization. Because of the peculiarities of the 
acquisition, there was no OR, and the system did not undergo DSARC review and 
approval. Rather, in May 1972 a pre-production contract was let and a LBTS 
constructed. The Mk 94, as modified into the Mk 92 Mod 0 GFCS, was Installed ' 
at the LBTS. The Navy assigned a unit to the LBTS to work with the contractor 
and to supervise the system modifications. This command consisted exclusively 
of technicians who reported to NAVSEA* None of the standard .acquisi tion 
milestones (DCP, NDCP, DSARC, etc J were identif j ed as havi ng been used in 
thi s acquisition. 

In August 1974, based on a Fast Cruise Test at the LBTS, the Mk 92 Mod 0 
GFCS was accepted for service use. A system was then installed aboard. the 
USS TALBOT (DEG-4) for TECHEVAL/OPEVAL which was conducted during the period 
November 1974 = June 1975, Based on these ivaluations the system received 
Service Approval . 

A NTPC^Tor the Mk 92 was held in August 1975. Periodic update conferences 
were scheduled to occur subsequently; however, no records of these conferences 
could be found. An NTP was issued after the first NTPC, although approval 
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did not occur until 1977. In June 1977, the approved NTP for the Mk 92 GFCS was 
incorporated into the overall FFG-7 NTP* and the Mk 92 NTP disappeared as a 
distinct entity. 

The Mk 92 Mod 0 was not the design selected for shipboard installation. 
Rather the Mk 92 Mod 1 was developed for the PHM, and the'Mk 92 Mod 2 systm 
fpr the FFG-7 class,. The additional missile control capability of the Mk 92 
Mod 2 is the basic difference between the two systems. Because pf the similar- 
ity of systems* the contractor developed a 28-week course--the first 20 weeks 
being devoted eKclusively to the GFCS Mk 92.Mod 1, the remaindervto the Mod 
2. A series of six courses were taught during the preproductloni phase* A 
discussion of each course in order of occurrence is presented belowi 

• January-August 1974 (Presented at LBTS by the contractbr): Attendees 
were OPEVAL/TECHEVAL crew from the USS TALBOT (6 persons), PHM 

crew (4 persons) s and LBTS personnel (6 persons). This course was 
not satisfactory primarily due to translation problems^ i.e., much 
of. the original Dutch material had not yet been translated; therefore, 
prints and wiring diagramr'Wi^f pften unintenigible. In additiori, 
no signal flow-diagrams were availablei little to no hands-on time 
on the actual equipment wM^heduled, and very poor living conditions 
for the students existed. This course was sponsored by the SHAPM 
(PMS-399). ... , 

• August 1974-February 1975 (Presented at the LBTS by the contractor): 
This was a signal flow course covering operations, maintenance, and 
software for the technical ratings who were to be aboard the USS 
TALBOT during OPEVAL/TECHEVAL. Development was independent of the 
original course, and the results proved to be satisfactory. This 
course was sponsored by the system development code in NAVSEA and 
was Independent of the training provided by the SHAPM. 

m January-April 1977 (Presented at the LBTS by Naval personnel 

assigned to the^ site): This was the first course designed especially 
for the Mk 92 Mod 2 course. It was prepared and taught from the 
applicable Ordnance Publications (OP) by Navy technical personnel. , 
Approximately 15 percent of the original contractor presented 
course (January 1974) was usable; therefore, this can be considered 
an independently d'^1 oped course. Course content was designed for 
the nucleus crew of the FFG-7, a highly selected igroup of men. 
This course was sponsored by the SHAPM. 

• April 1977: This course was a signal flow course of 4-5 weeks in 
length. It was designed as a combat systems maintenance management 
course to train technical personnel In the interrelationship of the 
various subsystems. This was a new course presented by the contractor 
under the sponsorship of the system devslopment code of NAVSEA, 

t April-August 1977: A course designed to teach the balance crew of 
the FFG-7 combat' system team how to operate the Mk 92 Mod 2^ system. 
The course was developed and presented by LETS personnel under the 
sponsorship of the SHAPM. ' 
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In addition to these system level courses, there were other courses 
taught on the subsystem, for example, the SPS-49 radar. The actual course 
development and implementation was done by the contractor. The work was 
authorized and funded by the system development code of NAVSHIPS. 

The initial version of the NTP called for the development of training, 
course material in accordance with MIL-STD-1379(Nj . Subsequently, when the 
revised MIL-STD-1 379(A) was approved, work had progressed to the point that 
change to the new MIL-STD-1 379(A) was not cost effective. The CNTECHTRA 
giride, CNTECHTRA A-10, ,was not cited in the contract because it had not been 
arcepted as a Navy-wide document and was not used by NAVSEA, Informal working 
arrangements were made whereby the contractor adhered to the requirements of 
MIL-StD-1379(A) as long as additional costs would not be incurred. However, 
contractor representatives stated that it was unrealistic to attempt to 
perform a task analysis in accordance with the contract schedule as there was 
no hardware upon which to base a task analysis. In addition, the training 
course material desires of the lead school differed from the stipulations of 
CNTECHTRA A-10, which differed from MIL-STD-1379. 

Figure D-4, Milestone Chart for Mk-92 GFCS Initial Training, depicts the 
major operational and training events as they occurred and are anticipated to 
occur. Of particular note 1s the lack of system acquisition milestones to 
which requirements can be tied. 
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Figure D-4. Milestone Chart for Mk-92 GFCS Initial Training 
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CASE IV. 1200 PSI STEAM. PROPULSION PLANT TRAINER (DEVICE 19E22) 

■ The technical coniplex i ties of the systems and equipments being operated by 
Naval personnel are increas.ing, particularly in light of the automation being 
introduced to reduce the number of personnel required to man and operate ships. 
As a consequence, training has become more reliant on highly sophisticated, 
expensive, specialized equipments devoted solely to training. Many of these 
trairiing devices are procu^'ed by one activity for use by another. Due to the 
technical complexities and post of many of these devices it was deemed appro- 
priate to investigate the initial training requirements of a sophisticated 
training device. The IZOC PSI Steam Propulsion Plant Trainer met established 
criteria and was therefore selected for study. 

HISTORY. When the Navy made the decision to utilize a 1200 PSI steam system, 
no serious training problems were envisioned. , However, initial 1200 PSI 
installations had proved unsatisfactory; fleet units were having serious 
operation and maintenance problems. At the direction of CNO, a study of this 
problem was made. This study culminated in the decision to construct a 1200 , 
PSf hot plant at NTC Great Lakes to be used by the Propulsion Engineering 
School for training. This hot plant is in use today. , 

In 1971 NAVSHIPS (now NAVSEA) conducted an audit of engineering training \ 
under the Technical Aud>t Program. Findings of this audit resulted in the 
recommendation- that a hot plant be Installed at the Destroyer School, Newport, 
Rhode Island (now the Surface Warfare Officer's School). Because of the cost 
of a' hot plant, a cost and requirements analysis was made of the hat plant 
vs. a simulator. Based on this analysis, CNTECHTRA, in 1973, decided to 
develop and procure a simulator. Funds were obtained in the FY 75 budget, 
and the contract was Tet In June 1975, ; 

-ive Navy commands were directly involved in the acqu if " tion of this 
s 'i;i,.itor. CNO (OP-39) funded the program and exercised proaram control. 
n/wSi:A (PMS-301) provided the technical documentation pertaining to the 
operationaT system and served in a review, monitor, and evaluation function. 
The specific tasks PMS-SOl was to perform were not detailed, and their records 
indicate their involvement commenced during the concept definition phase 
(April 1975). The NAVTRAEQUrPCEN was the designated development agency and 
provided the engineering and contractual services. However, the Software 
Support Plan was provided by the Naval Education and Training Support Center 
(NAVEDTRASUPPCEN) , Atlantic. Lastly, the Surface Warfare Officer School 
(SWOS) Newport, provided on-site contractual supervision and developed the 
course to be used for follow-on training. 

The simulator was procured outside of the normal acquisition cycle. 
Therefore, there was no OR, DCP, NDCP, or DSARC. However, alT mijor commands 
having a direct interest in Device 19EZ2 were involved early in the program. 

Initial training consisted of three courses, all developed and presented 
by contractor personnel: 
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• a computer course for a programmer/analyst and a computer specialist 
■■ • an operator/maintenance course conducted onsite 

• an instructor course conducted onsite. 

In addition to these courses s all prospactive instructor and maintenance 
personnel attended the Main Propulsion Assistant Course at the SWOS. 

Naval personnel at the SWOS evaluated the operating procedures for the 
1200 PSI operational system in conjunction with their task of developing 
courseware for follow-on training. The simulator duplicated the actual equip- 
ment Insofar as operating procedures are concerned and was constructed and 
tested at the SWOS sitej therefore, the follow-on course developers at SWOS 
probably had a greater understanding and more knowledge of the 1200 PSI system 
than any other group. For this reason, it is difficult to understand their 
need for operator training. , 

The contract for the 1200 PSI Simulator was negotiated to Include MIL- 
STD-1379(A), the only acquisition program investigated where the training 
package was designed in accordance with this military standara. However, the 
Data Item Description (DID) list omitted the three specific DIDs which jspecified 
the major difference between MIL-STD-1379 (N) and MIL-STD-1379(A) . These were: 

UDI-H-25522, Training Task Analysis Report 

UDI-H-25523, Behavioral Objective Report 

UDI-H-25524, Measurement of Student Achievement 

Thus, for initial training course development there was no job task 
analysis required, no Specific Behavioral Objectives (SBO) developed from an 
analysis, and no criterion tests developed to measure' student, proficiency. 
Since device 19E22 provided a training device to support a systan for which 
the acquisition program had been' compl eted , it is not possible to develop, a 
meaningful milestone chart. 

INITIAL TRAINING COSTS. Reliable cost data for initial training as well as 
resources required were not available. Examination of available data indicated, 
that the Initial training package was approximately 3.5 percent of the total 
contract cost. 

Overall, the contractor's cost breakdown fell into the expected pattern 
and within a reasonable range of the anticipated percentages for contractor 
developed and implemented initial training. Some discrepancies were noted, 
however, in labor utilization. With the Navy technicians and educators 
available at the SWOS, it is questionable that the operator's course was 
needed. 

One cost Item has been omitted from the total package of initial training. 
All personnel were required to attend the Main Propulsion Assistant (MPA) , 
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course at SWOS. Since this was an ongoing course and required by all engineei 
1ng personnel assigned to the SWOS, 1t was decided that the cost of attendance 
at the MPA course could not be attributed to the 1200 PSI simulator slone. 
Thus, these costs were not included, 
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APPENDIX E 



DATA COLLECTION INSTRUMENT FOR CONTRACTOR 
DEVELOPED TRAINING COURSE 
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PRICE ANALYSIS FOR CQNTWCTOR DEVELOPED TWINING COURSE 

a. PROPOSED p 

b. NEGOTIATED □ 



C, DATE ^ 

d, REVISION NO, 



Page 1 



PROCURING AGENCY 
feOUlPMENT/SYSTEM 



ADDRESS ' 

REP NO. /CONTRACT NO' 



"CONTRACTOR 



ADDRESS 



CONTRACT ITEM NO. 

COURSE LOCATION 



COURSE TITLE 



COURSE LENGTH (WKS) 



1* Preparation of Courie Data 


Pages or 
Quantity 


Position 
Titlel 


- 

Man-Hours 


Rate 


Total Cost 


1 1 TRATNTNR AND TRATNTNR 

EQUIPMENT PLAN 




A AAA . 


AAA A 


AAA 




111 Pocsairf*H ann 1 l3icnn 


AAA A 












A AAA 










1.1-3 Typi 












1 J *4 Printing 




xxxx 


xxxx 






1.2 TRAINING' COURSES AND 
INSTRUCTOR TRAINING 
SERVICES PROPOSALS 
(DNP-6200) 




xxxx 


xxxx 


XXX 




1.2.1 Research and Liaison 


xxxx 










U2,2 Wr1tin£ and Editing 


xxxx 










1.2,3 Typing 












1.2.^ Printing 




xxxx 


xxxx 






1 .3 TASK AND SKILL ANALYSIS 
REPORT 
(DI-H-6130) 




xxxx 


xxxx 


XXX 




1.3.1 Research and Liaison 


xxxx 










J. 3. 2 Writing and Editing 


xxxx 










Typing 












1.3.4 Printing 




xxxx 


xxxx 




), 



USE ONLY POSITION TITLES LISTED ON PAGE 7 OF THIS FORM. 
REFER TO PAUE 7 OF THIS FORM FOR ADDITIONAL INFORMATION. 
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Page 2 



1 CQuf^e Data (eontifiued^ 


Pages or 
Quantity 


Position 
Title 


Man-Hours 


Rai^ 


- TotiT Cost 


1.4 TRAINING COURSE/CURRICULUM 
. OUTLINES (OPTION ' ) 
(0I-H-6197j 




XXXX 


XXXX 


// 

/ tM 




* 1*4*1 Resiarch and Liaison 


-XXXX 










1.4*2 Writing and Editing 


XXXX 




/■' 

/ 






1.4.3 Typing 












1.4*4 Printing 




XXXX 


xxxx' _ 






1.5 TRAINING COURSE INSTRUCTOR/ 
LESSON GUIDES 
(DNH-6198) 




XXXX 


XXXX 


XXX 




1.^.1 Research and Liaison 


XXXX 










1.5*2 Writing and Editing ^ 


XXXX 










1.5.3 Tyj)in£ 












1 * 5.4 Printing 




XXXX 


xxxx 






1.6 TRAINING COURSES STUDENT'S 
GUIDE / _ 
{0I-H=6199) / 




XXXX ^ 


" XXXX ^ 


XXX 




1.6.1 Research and/ Liaison 


XXXX 










1.6.2 Writinq and Editing 


XXXX 










1.6.3 Typing 






— " """1 






1.6.4 Printing 




XXXX 


XXXX 






1.7 TRAINING EQUIPMENT AND TRATNIN 
COURSES AUDIO-VISUAL AIDS, MAS 
REPRODUCIBLES AND REVIEW COPIE 
(DI-EH6124) 


G 

TER" 
S 


XXXX 


XXXX 




- - - 


_L^7_ j _ Aei.e.a _h and Liaison 


XXXX 










1.7.? Writing and Editing 


XXXX 










1.7.3 Typ ing 












1 .7,4 Printing 




XXXX 


XXXX 
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1, Course Data_ (continued) 


Pages or 
Quantity 


Position 
Title 


Man-Hours 


Rate 


Total Cost 


1.8 TRAINING EQUIPMENT AND 

TRAINING COURSES AUDIO-VISUAL 

AIDS INDEX 

(DI-E-6123) 




XXXX 


XXXX 


XXX' 


■ 


1*8,1 Resiarch and Liaison 


XX XX 










T,8.2 Writing and Editing 


xxxx 










1.8.3 Typinq 












1.8.4 Printing 




XXXX 


xxxx 






1.9 MEASUREMENT OF STUDENT ^ 
ACHIEVEMENT TESTS 
(DI-H^2G33) 




' xxxx. 


XXXX 


XXX 




Research and Liaison 


xxxx 










1,9.2 Writing, and Editing 


xxxx 










1.9.3 Typing 

: : »£_C 












Printing 




xxxx 


xxxx 






IJO STUDENT AND TRAINING COURSE 
EVALUATION FORMS 
(DI-P-6167) 




xxxx 


xxxx 


XXX 




IJOJ Research and Liaison 


xxxx 










U0,2 Writing and Editing 


xxxx 










1J0.3 Typing 












1 . 10.4 Printing 




xxxx 


xxxx 






1.11 INSTRUCTOR'S SIMULATION 
EQUIPMENT UTILIZATION 
. HANDBOOK 
(DNH-2028) 


- — -~ 


- / 

xxxx 


xxxx 


XXX 




1.11.1 Research and Liaison 


xxxx 










1. 11 .2 Writing and Editing 


xxxx 










1.11.3 Typi.ng 












1.11.4 Printing 




xxxx 


xxxx 
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1. Course Data (continued) 


Pages or 
. Quantity 


pDsltton 
Title ' 


Man-Hours 


SjRate 


Total Cost 


1.12 ON»THE-JOB TRAINING 
HANDBOOK 
(DI-H-20Z9} 




XXXX 


XXXX 


XXX 




1.12,1 Research and Liaison ^ 


XXXX 










1J2.2 Writing .and Editing 


XXXX 










1.12.3 Typing 












1.12.4 Printing 




XXXX 


XXXX 






K13 CONFERENCE AGENDA 
(DI-P-6202) 




XXXX 


^ XXXX 


XXX 




1,13,1 Research aiid Liaison 


^ ■ 

XXXX 








~— — 


1J3,2 Writing and Editing 


XXXX 










1.13. 3. Typing 












1.13.4 Printing 




XXXX 


XXXX 






1.14 CONFERENCE MINUTES 
(DI-P-6201) 




XXXX 


XXXX 


XXX 




1.14,1 Research and Liaison 


XXXX 










1.14.2 Writing and Editing : 


XXXX 










1.14; 3 Typihg 












1.14.4 Printing 




XXXX 


XXXX 






1.15 RESEARCH VISIT EXPENSES / 


XXXX 


XXXX 


XXXX 


XXXX 




1.15.1 TRAVEL EXPENSE 


XXXX 


XXXX 


TRIPS 


P/TRIP 




M5.2^-^ PER DIEM EXPENSE ' 


XXXX 


XXXX 


DAYS 


P/DAY 




1.15,3 CAR RENTAL EXPENSE ^ 


^ XXXX ■ 


XXXX 


DAYS 


P/DAY/ 
















1.16 OTHER (Specifyi 




































SUBTOTAL OF fTEM 1 
UNDERLINED ITEMS 




XXXX 


1 


XXX 
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Pagt 5 



2, Course Material 


Quantity 


r \J3 t L lull 

Title 


Man-Hours 


Rate 


Total Cost 


2.1 TEXT MATERIAL FOR 
STUDENT RFFERFNCE 




XXXX 


XXXX 


XXX 




^ t 1 c 1 ri ^1 ifiiiiiaiy iiQimuuwr%d 




XXXX 


XXXX 


XXX 




. - - ----- 1 

2-1-2 Other (Specify) 
























2*2 TRAINING AIDS 




XXXX 


XXXX 


XXX 




2.2.1 Labor 


XXXX 










2.2.2 Material 




XXXX 


XXXX 


XXX 




2.3 REPAIR PARTS DURING COURSE 




XXXX 


XXXX 


XXX 




2.4 OTHER (Specify) 




































SUBTOTAL OF ITEM 2 
UNDERLINED ITEMS 




XXXX 




XXX 




2 

3 In^trurfor PrpD^ration ExD&n^p 












3 1 RESEARCH AND LIAISON 




XXXX 


XXXX 


XXX 




111 Flr^^^ Tn^trurtnr 












3.1.2 Socond Instructor 












3.2 LIAISON VISIT EXPENSE 




XXXX 


XXXX 


XXX 




3.2.1 Per Diem Expense 




XXXX 


Days 


P/Day 




3.2.2 Travel _ Expense 




XXXX . 


Trips 


P/Trip 




3.2.3 Car Rental Expense 




XXXX 


Da^s 


___ P/Day 




3.3 OTHER (Specify) 




































SUBTOTAL OF ITEM 3 ^: 
UNDERLINED ITEMS ^ 




XXXX 




XXX 





INCLUOES ONLY THOSE EXPENSES INCURRED TO PREPARE FOR COURSE PRESENTATION, 
DOES NOT INCLUDE COURSE DEVELOPMEfg EXPENSES, 
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Course Presentation Expense 


Pages or 
Quantity 


Position 
Title 


Man-Hours 


Rate 


Total Cost 


INSTRUcbRS SALARIES 


XXXX 


XXXX 


xxxx 


XXX 




4.1.1 First Instructor 


XXXX 










.4*1.2 Second Instructor 


XXXX 










4.1,3 Per Ditrn Expense 


XXXX 


XXXX 


Days 


P/Oay 




4,1.4 Travel Expense 


XXXX 


XXXX 


Trips 


P/Tri^ 




4. 1,5 Car Rental Expense 


XXXX 


XXXX 


Days 


P/Day 




4.1.6 Other (Specify) 


XXXX 


XXXX 








^^,2 OPERATORS SALARIES 


XXXX 


XXXX 


xxxx 


XXX 




4.2. 1 Fi rst Operator 


XXXX _ 










4.2.2 Second Operator 


XXXX 










1 

^ O T D n w n ■% f^rri C w A iF^ q 

, j Ker uieni txpense 


XXX)( . 


yyyy 

AAA A 


-- yyyy 

A A A A 






4 ? 4 Travel F^^npn^e 




XXXX 


Trips 


P/Trl p 




4 ? ^ Car Rental Exoense 


A AAA 


XXXX 


Da vs 


P/Day 




4 ? 6 Other fSDecifv) 


yy yy 

A A A A _ 






















^IIRTnTAl OF TTFM 4 
UNDERLINED ITEMS 


XXXX 


XXXX 




XXX 




5 General 


y y ¥ y 

A AAA— 


A A A A 


yyyy 


yyyy 


Y y ¥ y 

^ AAAA 


\ 

5 J GENERAL AND ADMINISTRATIVE 


XXXX 


XXXX 


xxxx 


/ 




5,2 OVERHEAD 


XXXX ' 




xxxx 


'' - 




5.3 PROFIT 


XXXX 


XXXX 


xxxx 


















SUBTO.AL OF ITEM B i / 
UNDERLINED ITEMS 


XXXX 


xxxx 


.... _ xm . . . 







ERIC 
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Pages or 
Quantity 


Position 
Title 


Man-Hours 


Rate 


Total Cost 


5. Total Training Cdurse Cost 
(Sum of Items 1 , 2^ 3, 4, & 5 
Subtotals) 




XXXX 




XXX 





NOTE: For purposes of .standardization, the preparer of this form is requested to use 
only the position titles included in the Labor Surimary below (to be completed by 
the contractor) in classifying personnel assigned to the training course program. 
Contractor position titles will not in all cases be the same, as those listed 
below* In these cases, the most appropriate position title listed in the Labor 
Summary will be used and a brief explanation provided under the. Remarks Section, 
if necessary. ' . ' 



LABOR SUMMARY ' ' 


Position Title 


Development Hours (1 & 2) 


Presentation Hours (3 S 4) 


1. Manager/Supervisor 






Training Specialist 






3. En^'neer 






4. Senior Engineer 






5. Typist/Clerical 






5, Instructor 






7. Senior Instructor 






B, Technical Writer j- 




iLLystra tor/ Draftsman 




10, Technician 






TOTAL 







REMARKS: 



/ 7 



76 



TAEG Report No. 68 



APPENDIX F 

COST MANAGEMENT CONTROL' PROCEDURE DATA SUMMARY 



\ 



1i 



ERIC 



COST D^TA 



DATA SUMMARY 



Enpine* 
Ci'lagoi'jr 



i TRAINING ^EC. 

liNCINilR , 

!i, mimm 

iTYPIiT 
rihiTRUCTDR 
!S. INSTRUCTOR 
ITECH^ WRITER 
ilLL^TRATOR 



! ieOURSE A m HOUfiS) 
!!Divilmnt llmplfBmt 
IIRltilHeurlBatelHeur 
:!li.6! lOllhS 

!!--!--!- 

M 4.S! 81! 4,6! 6! 

1.7! SOO! 8.9! 40! 

U.6! iQQiU.r 40 

i i 



I i 



CttRSE g (440 HOURS) 



! !08«iiiiint iltnplinin* ! 
TOTAL ! I— — -,u— — -!TOTAL 
!!Rati!Heur!Riiti!HQUP 

3a5!!ll,4! 305!11.8! S2 

Qi ! j I j „ 

oii I I i 

0!! --!-!"!- - 
400!! 4.4! IS4! 4.6! 132 
2104!! i.SlilBO! 1.9! 440! 
af07!!li,4'!glB5lll.B: 440! 

Qi I j i i ,^ i 



!!eOURSE D (4B0 HOURS) 
iiOivilninl ilmplwint 



iRatBiHBUPlRitilHDUr 



! !' 
4110!! 
0!! 
0!! 
01! 
iS35!! 
£2624!! 
30£49!! 
0!! 



9.1! 

i 



17! 



TOTAL 



\\mm 1 (SO HOURS) 
!,|Deyeltnnt !Iinplinin1 



! ! 
,-!TOTAL ! 
1 1 Rate ! Hour !Ritf! Hour!. I 



i I 



.1 . 



4.4! 



417! ! ! 

1050! 



77 



IMATIRIALS '! 

iTRAViL !! 

!"—"-»—*'!■ 
! TOTAL HOURS ! ! 



sia ! 



I 00129 

! 00750!! . 

89 ! soil! 5324 ! 



6.9!SQ0a! 7.B 

I «i I 

0!! 6.5! 124! -- 

' ! 05440!! - I 

! 0S8BB!! ! 

1064 ! 638B!! 2560 ! 



156!! -» 

01! " 

0!! -- ! 
0!! ! 

1851!! 4.0! 

S1709!! -= ! " 
0!!10.S! ail 

0!! 6.7! 105 

814!! " ! " 

03279!! , 
06.860!! 



10.5 



iOiO ! 3610! 



473 



i 0! 
! 0! 
i 0! 
! 01 
3081 
0! 
4167! 
706! 
0! 
! 

01194! 

!■=- ! 
.....I. .=...( 

104 ! 577! 



104 



Adffliniitnatiwi IICOUfiSEA (40 HOURS) 



iCouflSE; B (4^to mms) 



mmm 

6 & A 
PROFIT ' 



■!!■ 

I i 
i i 



Rati 



TOTAL 



!! COURSE D (480 HOURS) 



i COURSE E (-SO HOURS) , 



67. L. 
10.1 
10.0 



3851 
I 1063 
1159 



Rati 


! TOTAL 


! Rati 


! TOTAL 


! ! Rite 


! TOTAL - 


68. a ■ 

10.1 
10.0 


! 41275 
! 11718 
i 12785 


1 85.9 

! a&.o 

! 12.0 


' 31073 
! 14493 
! 8428 


!! 87.4 
!! 40. C, 
!! S3,S * 


! 45lii 
! 4427 

! m2 





! ^COURSE A (40 HOURS) 




!!COURSE 0 (440 HOURS) ! 

i i I 


COURSE D (>B0 HOURS) 




! COURSE E (BO HOURS) ! 


i Catagory 


' 'Oeyflmrit'lmpimrit ' 


TOTAL . 


'IDivilfiint 


ifflpiRint 


! TOTAL ! 


Df¥ilmnt!lfflplinnt 


! TOTAL 


!Diyiliiint 


Ifflplffliit ! 


TOTAL ! 




' 'Libor 




Labor 


!!LabBr 


Labor 


' Labor ! 


Libor 


!Libor 


! Libor 


!Libor 


Libor ! 


Libor ! 




!!Cest 


iCoit ' 


CDlt 


MCos* 


Cost 


i Colt ! 


Coit 


'Colt 


! Coit 


!CQii 


Coit ' 
^ !- 


Coit ! 


'MANSER ' 


! ' 0603^0 


035 ! 


385 


! ! Qoms 


0618 


! 4110 ' 


000 ISC. 


i 


! ISC 




i 


0 ! 


TRAINING SPtC. 




J ' ! 


0 


1 1 




'. 0 ! 




1 


1 0 




1 


0 I 


ENGINEEn 


i \ 


i . ^ i 


0 


1 1 




! 0 ! 






! 0 




I 


- 0 ! 


S. ENCINEEH 


i i 


f = , ! 


0 






.0 ' 






! 0 




! 


0 ! 


TYPIST 


!i,00O37S 


' Odl ! 


400 


!'Q029ii3 


0613 


' 3535 ' 


QOlBbi 


i 


' ■ 1051 


! 00030M 


i 


308 ! 


INSTRUCTDR 


!' 001748 


' OJSC ' 


2104 


" 018704 


03'D20 


', 22624 ' 


013213 


' 07896 


' 21709 




1 


0 • 


a. iNSTRUCTDR 




i 0475 ' 


2a07 


M oasolo 




1 30249 ' 




1 


! 0 


! 003070 


1097 * 


4167 ! 


TECH, WRITER 


1 1 ^ = 


i 1 


0 


1 1 




0 ' 






' 0 


! 000706 


! 


706. ! 


ILLLEfRATQN • 


II 




0 


1 1 




! 0 ! 


oooai4 




1 814 


i J = 




0 ! 


TOTALS 


' • mOii 


m<j ! 


K •/ 


mm 


1030C 


' mm ! 




' 7a'D6 


' mm 


! 40B^ 


1097 ' 


5181 i 



GRAND TOTALS 



im'k 



79 



am 



ERIC 



CpST DATA 



DAI A OUMMARY 



i 

I— ' 

! MANGER 

JTffAlNING S'EC. 
flNSlNEER 

IS. zmmm 

I TYPIST 

!8* INSTRUCTS 

iTKH, mitm 

I ILLUSTRATOR 



! MATER 
! TRAVEL 



'TOTAL HM9'.j 



'Develnint ; Implemnl 



Eipencf !iCOURqE M .ag HOURC) ! ! CPUfiSS I ( HOURC ) 

IIDivHrntit llmpltmnt 
TOTAL M=— — ■ 
' IRill'HBur 

Oil i 
0!! " I " 




Rite 



Htur 



IWil S.O' 4801 9,0 
7422!' i.O! £38! - 
!'— — — r 

0JO6Q" ■ ; 

01070!' 



MO 



1^74' 



!CDURSC J (4S0 HOURS) ■ liCDURSE K ISO HQURIJ) 



TOTAL ! 



Dfvelniri t ' InipUnin-t I 



TOTAL 



t 


Ritt 


Hour 


Rati 


Hour! 




IRiti 


HourlRili 


Hour! 


0!1 










0 


!1S.7 


IS! - 




01! 










0 


! - 






6447! 1 


9.0 


V397' 






ia&i4 


I " 


- I 


"J 


0" 










0 




' ^ i 




O'l 










0 


! S.4 


110! - 




BC6B! : 




■3iO' 


3.0 


'560'' 


17337 


!i0.7 






0! i 








1 


0 


jl4.8 


10^6' 14.1 


SO' 


ai4'a! ! 




740! 




i 










948' ! 


ki, 








1B9& 




1 




! ! 








,^--= i 











03S4'3' ! 

04020! ! 
— I- 

£017'! 



3307 



m 



! 0€.C3Gil 
I 06S40il 



DfVflmn-t !lJnplen!nt ! ! 
— ""'— —HTOTAL ! 

■ ! 

233! 
0! 
Of 
0! 

m* 

3417! 
167&1! 
0! 
0! 

! 01423! 

I f 

80 ! • 15741 



;494 I 



' Adniini^tfitivt MCOURSCH (BO HOmS) 
Costi 



'I COURSE 1(240 HOURS) 





! ' Rati 


' TOrAL- 


! Riti 


' TOTAL 


! Ratg 


! TOTAL 


!! Rati ■ 


! TOTAL 


lOVERHAi) ' 


' ' B1.& 


' ' lasBs 


' 100.0 


' 18213 


1 100,0 


i 11531 


!! 57,4 ■ 


! 12091 




'' 10.0 


' 3170 


' 09. 1 


' 4030 


! 10,0 


' 3033 


!! 11,5 


i 3'37G 


! PROFIT 


!' 07.4 


! asso 


' 07. 3 


! 2531 


! 08,0 


! 7949 


!! 15.0 


' 5783 



! COURSE J (480 HOURS) 



! COURSE K (BO HOURS; ) ! 



! liiptnef 
! QsiaqoFY 
! 



iriANGbR 

!TRAINING SPEC 
liNCINEER 

!i, zmmm 
iTypisT 

!INSTRUJTrjH 
19, iNSTRUCIUf! 
ITiCH, WRITER 
lILLLiTRATDR 

It □ T A L S 



COURSE H (80 HOURS) 

Dsv/tlmnt' Implmnt ' rOTAL 
LibQp 'Labor I Labor 
Coft' 'Cost ' Coit 



0034,48 
002350 



007453 I 
000316 ! 

'13737 



1444 



1444 



!! COURSE I (£40 HOURS 

' tDBw,.linnt' Irnplfflivt 
'"!Lflbof !LabQr 



i 1 



Colt 



!Cait 



! icmm J (480 HOURS) 

TOTAL I IDiyelmntilmplniiit ! TOTAL 
Libor nLabor ILabor ) Labor 
Coit ! 'Call !Cost ! Coit 



! COURSE i< (BO HOURS) 



IDiyiliiint 

'Libor 

iCsit 



lifflplinnt 

ILiber ' 
•Celt 



0 I 

0 ! 

3C.4B !! W6447: 

0 " " 

1350 ! 

1444 !' 004334 ' 

0 !''N^ ' 

74£g '! 002149 ! 

316 !! 000948 i 



4334 



15181 



I i 



13879 ! 4334 



I 



0 i 


1 s„ 




0 


1 1 

!! 


000283 


0 ' 






0 


1 ! 




6447 ! 


! 012614 




iaGi4 


! 1 




0 1 


! = 




0 


i,| 




■ 0 ' 






0 


!! 


000594 


sm ! 


' oostsa 


mm 


17337 


!! 


003427 


'O ! 






: 0 


!! 


01 5164 


ai49 ' 


i oo66sa 




6682 






'348 1 


I 00 ISM 










19213 ! 


! Biay 


mm 


38531 


i j 


I'BIM 



QRANO TOTALS 



17450 , 51B54 ■ 



011% 



1191 



TOTAL 
Labor 
Coit 



■! 



m ! 

0 ! 

0 ! 

0 I 
.594 ! 
3427 ! 



107321 



I1Q6I ! 
44341 



ERIC 



SO 



COST DATA 



DATA SUMMARY 



iTVPir 

!TiCH, WRITER 
!IU,LBTRATOR 



iMATERIi 



lALS 



Divfimni llniplMint 



MCOURSE L (SIO HOURS) - !! 

••Divilinni 'llfflplinint i 

HRattiHouHRatelHQUfI 

'ill.7! IS! " ! -= i It 
1 1. I I I 1 I 



--!-—"— ITQTAL 



!HDurlRat|iHsur 



1 



107! - ! 
110.71 Bm' 



l&OI 



!TOT^ HOURS 



AdminiitraiiVi 



^ 00753!! 
m ' 2303!! 



iCOURSC L (IGO HOURS) 



Rate 



llmpUmnt 
!Riti!HeuMRiti!Hour! 



,11, 



0!! 





Rate 



!! 

IIDiviinint !Iinpli 

!!Riif!HBUP!Rati! 
— !!-—! — !-'"! 

0! ! — ! — ■ ! -■ 



0 ! 



TOTAL 



= 5 i -S 




Rati 



TOTAL 



0! 



I Elipenci 
! Catagory 



IM&ER 

iTRAINiNO SPEC. 
liNQINEEH 
!i, ENClNEEn 
ITYPIOT 
!INSTRUCID« 
!i, iNiTRUCTDR 
iTtCH. WRITER 
! ILLUSTRATOR 
!"-™- — 
!T Q T A L S 



'COURSE L ilM HOURS) 



lOevBlmnt 

'Labor 

'Colt 



ilmplmnt 
! Labor 
!C05"t 



00018^3 



mm 



TOTAL 
Labor 
Ceit 



!Divilfflnt'liiiplmnt 



! Labor 
!CBlt 



ILibBr 
'Colt 



! aS70 ! 



' 313S7 



TOTAL 
LibDr , 
Cost 



IDiVilmnI 

ILibor 

IColt 



Inipimnt ! TOTAL i IDiyilmnt ' Implnint ! TOTAL 



Libor 



Labor 
Cost 



0 ! 



! Libor 
iCsst 



0 ! 



! Libor 
!Coit 



Labor 
i Cost 



0 ! 



=S=-S====S==E ====== =2= 



S R A NO 



r A I 



67e65 



ERIC 



■3 



CUOT DATA 



DATA GUMMARy 



pita Bfiak Down by Eapinct Cit#gorx 



mmm 



COURSE 
CQURBE 

CtJURSC 

CDURSi; 
COURSC 
COJRSE 
CUIJRSL 



(^0 HDURO) 

( 440 \wm) 
(Am mum \ 

(00- HOURS ) 
m HOIRS) 

USQ HQURG) 



TOTAL Ci3iiT 



385' 
4110' 

ISC' 
Of 
0' 
0! 
0! 

383' 



'COUROC A 
'CCUHQL D 
'COURSr D 
iCajRSL E 
'COURQC II 

'COURSL J 
'COURiiE K 
'COURGE L 



(40. mUBSl 
(440 HMO) 
(480 HUJR3) 
(80 HOURS 1 

(80 mm) 

(240 t JR!3 i 
(4S0 HOURGL 
(iO HQLRS) 
(l&O HOURG) 



51d4' 



'TOTAL COST 



Coil 



I ENGINEER 



' Co 



0' 

0' 

0' 
0! 
0' 
0' 
0' 
0' 
0' 



ICQURRG B 
ICQLIHGC 
ICEIURDE 
ICQURDE 
! COURSL 
ICDURyC 
'COURfiE 
'COURBE 



(40 HDURy) 
(Wip HOURS ) 

(486 mmu) 

(BO HOUR05 
(80 HOURS J 

(340 mmm 

(4B0 HOURS) 
(iO I-IDURQ) 
(i&O HDURS) 



it / 
0! 

; 0! 

Of 

0! 

3048 : 

mi] 

1SC14I. 

0' 
0' 



! 



CIXJRSE 

CQURSC; 
CQURBE 



COURSE H 



CPURSE 
COURSE 
COURSE 
COURSE 



(40 .HOURS i 
(4<fc6 WQURS) 
(4B0 HmJRS) 
(80 HOURS ) 
(SO HOJRS) 

(240 mm) 

(480 HQURG) 
(80 HOURS) 
(l&O HQURD) 



ruTAL CQUT 



a. IN^jTRUCTOR 



COURSC A 
COgRSC D 
COURSC D 
COURBE t 



COLWSE H ( 



COlJiiC I 

cQURae J 

COi*iSC K 

cotJ^st; L 



40 HOURS) 
4A0 HOURG) 
480 HOURS) 
BO HOURS) 
BO HOURS) 
240 HOURSJ) 
430 HOURS) 
SO HOURS) 
m HOURS S 



TOTAL COST 



Coit 



0' 
0' 

0' 
0' 
0' 
0' 
0! 
0' 

0' 



TVPIGT 

COURQC A ( 

COURUCt ( 

COURSE 0 ( 

COURSC E ( 

COUREIC H ( 

CDURQE I ( 

COURSE J ( 

CDUR'iiE K ( 

COURSE L C 



Cijit 




40 NOURS) 
440 HOURS) 
4B0 HOJRiii) 
BO HUURS) 
iO HJURS) 
240 HOURS) 
4S0 HOURS) 
go HOURS) 
ICO HDURS)-' 



TOTAL COOT 





■tio HOURG) 
(440 HOURD) 
(4gO hOLFS) 
(iO HOURS) 
(BO HQURO) 
(£40 HOURO) 
(4S0 HOURS) 
(BO HOURS) 
( 160 tCURD) 



%17' ! TOTAL COST 



TECH.' WRITER 



ICDURiJG A 

'CDURWE D 

! COURSE D 

'CnURGE E 

'CDURK H 

'COURBE I 

'COURSE J 

'COURSC H 

'COURSE L 



(40 HOURS) 
(440 HOJRS) 
(4B0 HOURS) 
(SO HOURS) 
(80 HOURS) 
(240 HOURS) 
(480 HOURS) 
(SO HOURS) 
(160 HOURS) 



aim I ! TOTAL COST 



Colt 



0' 
0' 

im' 

f'4S2' 
tjl4^' 

0' 
Q' 



iLLusiRArriR 



COURBE 
COURSE 
COURBE 
COURLC 



COURSi; H 



COURaE 
COURBE 
COURSE 
COURBE 



(¥} HOUR;^) 
(440 HQUiD) 
(480 HOU^S) 
(BO HQURffl) 
(80 IIQURS) 
(240 HOURS) 
(4B0 HQURa) 
(SO HOURS) 
(160 HOURB)' 



TOTAL COOT 



dl04! 

aaG^4! 

0! 
1444! 
866B! 
17337! 
3427! 

0! 



77317! 



Cost 



: I 
t 

Of 
0! 

814! 

0! 
316! 
54B! 
1816! 

0! 
afjTO! 



&B45! 



er!c 



82 



CQ'J I LiA f A 



3I.JMMAf DA I'A 



(j T A i: ' . 



[0t.|i 



i; ^ ^ ^ .; .. .. ■.: 

Percent 
Total 





Li)! ' 


u.o:t ^ 


mil ' 


ji.ia X ' 










I ' 




c^C. 73 I ' 


mn ' 










ilVii'd ' 


Ui.k^ ^ ' 














10.71 I ' 




Vi,Q2 I 






■ 3.2b r. ' 






mn ' 












s. id I ' 




0,00 I 



CQlt 



Percent of 



iOiAL 

Colt 



5181 

3€03 



T 0 f A L S 



ERIC 







iij-'SO ' 


100.00 ' 




100, uo 






mm : 






i--z;:_-r-r-::.--:;j: 


■I 3 !i J ^ ^ - - 




■ : : ^ s ;^ ^ ^ ^ ^ -; - 




r. = = 5 = 5a.= s = i- ! 


,^ - 






:■ c ^ d I *J ^ 


_ -'^^y ; - ^ r , ^ 


- .i ^ ^ I i: :L ^ ; _ - ± 












'CUURjE I ((2W:iOJR':^) 


' 'COURT J NllJRS) 


-CUURBi: K (30 WUnG) ! 


' ' P9r(:f?r, ^ 






' l-'eruHit of ' 


rUFAL 


^ ' Percent o! 


' roTAi. 




' TUTAL ! 








lij'dl 


Oy-. 1. 








Coit . ! 






1M81 ' 


IS. If^ X ' 




B.OO ? 




47,K! ^ 


' Si066 ! 




V 
'• 














ILWI ! 




7. 


.jl/0 ' 


7,77 f. ' 


4030 


' ' 8,4! ■; 


'303 J 




3^7t I 


?■'} 






C.SO ■'. ' 


m 




rwi 




57S3 ' 








I. he I ' 


:m 




OOiG 




1423 ! 






! ;j7i) 


7,75 r. ' 


40CO 




SG40 


0.00 ^ 


0 ! 






]'-.'..0 ' 


100.00 ' 




iOO,00 




' ' 100. Oj 1 








. J „ ^ J ■. .; r J ^ ^ 


;. - r - ; ^ t ;: ^ J 






ZZ7.^ = ::.-. ■ ■ H :T ■ 


:i = = s = E = ;: = ? = -~^ •?-^=l 


... _■ :* r; . .; " 














-: V ;7 = = ^ ^ ? = - - - 








g HOUR';) 








i ! 


! 



Prr':f?r.t oi 
rotdl 

30. V- ■: 

8.S'} X 

1.11 z 

I I 

" 100,0 I 



Ccv. 

J13l'7 
c:0738 

eodi 

r,n -^r■ 

7s^ 

0 



: i i ^ "J. r z r 2 ^ ^ ^T. r. r, :i z i:t.z z.::: z 







■ PsfC^ipf iif 






Total 


0,00 X ' 


0 


0.00 ^ 


0.00 X ' 


0 


' ' 0,00 I 


0.00 1 ' 


0 


Q,m I 


0. " 0 ' 






0.00 ' 


0 


0,00 X 


0.00 '. 


0 


" 0.00 X 


100,00 X ' 


1 , 


100,00 A 









CD5t 



P?rtf.r,t (,( 

0=M 1 
0.00 ?. 
0,00 
0,00 



milt 



0 
0 
0 
0 
0 
0 



100,00 X ' 1 



Ci'mr DATA 3UMMAf<Y DATA FlOUni.. I . 



0 .[)'ib = .r J^- r ^3 ' 5 ' I ? ' '10 r^'^U kT.^U J'J*W V3^LU b'f(;0^?i' 



L 



8. 



i i I 



coital' 0 ! Q ' 0 ' 0 ' £^ ^ 0 ' 0 ' :i ' ^ ' a ' u ^ 0 



ERIC 





"C'ii iH'i A 


(AO HO! J':;) ' 


'CuUROL t; 




















■ ■ - - 

'PerD-nt ' 




' 'i, jf.-jf 






'Lribi5f 






It- r, y U ! 




' 'My ill"". 


Lihnr 




'Hgurs 








Mm! i r ' 




' 'h? 1 






'Per i 






'LeiL:^ ■ 
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